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DESCRIPTION OF THE PURPOSES AND FUNCTIONS 
OF THE DIAGNOSTIC READING TESTS 

FRANCES ORALIND TRIGGS, CHAIRMANi 

The puipose of this paper is to report the construction of 
a battery of diagnostic reading tests and to indicate areas of 
projected lescaich. 

The work of the Committee on Diagnostic Reading Tests, 
the body of specialists responsible for the construction of these 
tests, was recently described in some detail in an article in 
School and Society.^ It will be given here only to the extent 
that it affects the present report. 

The purpose of the Committee in constructing these tests 
was to provide tools for surveying the reading skills of students 
from the seventh grade through the college freshman year in 
order that (1) a diagnosis of any existing disabilities may be 
made and appropriate remedial instruction instituted for re- 
tarded leaders and that (2) reading instruction and materials 
may also be better adapted to the skills of generally normal 
pupils. 

The battery of tests was developed by a committee of 
specialists in the field of reading under a grant of money from 
the Blue liill Foundation. This grant covered the develop- 
ment of materials only — not their publication. The proceeds 
from the sale of materials now available will be used to finance 
the publication of the remaining tests of the battery. 

^Tliis article was prepared by the Committee on Diagnostic Reading Tests, Inc , 
which includes the following members 

Robert M, Bear, Dartmouth College 

Ivan A. Booker, National Education Association 

Daniel D, Fcder, University of Denver 

Constance M. McCullough, San Francisco State College 

A. Eason Monroe, San Francisco State College 

George D Spache, Chappaqua, New York Schools 

Arthur E. Traxler: Educational Records Bureau 

Frances Oralind Triggs, Educational Records Bureau, Chmrman, 

®Triggs, Frances Oralind “Diagnostic Reading Tests as Aids to Remedial 
Instruction.’' School and Society, LXVI (1947), 42-45. 
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The plan of the Committee is to provide for continuous re- 
search on the tests and for revision of them as needed. Since 
the project is entirely a nonprofit one, all proceeds from the 
sales of the tests in excess of publication costs are to be devoted 
to these purposes. 

The members of the Committee on Diagnostic Reading 
Tests are: Robert M. Bear, Dartmouth College; Ivan A. 
Booker, National Education Association; Daniel D. Feeler, 
University of Denver; Constance M. McCullough, San Fran- 
cisco State College; A. Eason Monroe, San Francisco State Col- 
lege; George D. Spache, Rohrer, Hibler and Replogle, New 
York; Arthur E. Traxler, Educational Records Buieau; and 
Frances Oralind Triggs, Educational Records Bureau, Chair- 
man. 

All sections of this battery are adapted for both machine 
and handsconng except the oral test. Tentative percentile 
and grade norms are provided, but it is hoped that schools 
using the tests will send scores to the Committee in order that 
these norms may be supplemented and more extensive data 
for further research may be available. 

The following outline indicates areas which the battery of 
tests cover: 

1. Survey Section — A survey or screening test to provide a 
reliable instrument for determining the general level of reading 
achievement of pupils m junior and senior high school and in the 
freshman year of college, including measures of rate of reading 
simple material of general interest, meaning vocabulary, and 
comprehension of textbook material. 

2. Diagnostic Sections — ^A series of diagnostic tests, to be 
given when reading disabilities are discovered through the use 
of the survey test. The diagnostic tests cover the following 
areas; vocabulary, auditory and silent comprehension, rates of 
reading under vaiying conditions and of various types of sub- 
ject matter, word attack and word recognition skills. 

Section I of the diagnostic test battery, the Vocabulary 
Test, yields scores in the following five areas: general vocabu- 
lary, vocabulary of English grammar and literature, vocabu- 
lary of mathematics, vocabulary of science, and vocabulary of 
social studies, 
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Section II, Comprehension, is presented in two parts, Si- 
lent and Auditory. The tests measure comprehension of text- 
book-type material drawn fiom the social studies, science, and 
literary fields^ The reading material is graded in difficulty 
according to the Lorge formula and according to more sub- 
jective criteria such as composition, structure, and type of 
content. From scores on the two parts of the test. Silent and 
Auditory, a comparison may be made between the pupil’s un- 
derstanding when he reads material silently and his under- 
standing when it is read to him Thus, some estimate can be 
made of the extent to which a reading deficiency may be handi- 
capping a pupil’s ability to comprehend what he reads, and the 
extent to which insufficient maturity and poor background 
make it inadvisable to attempt to present ordinary textbook 
materials. 

Section III of the tests. Rates of Reading, has three parts. 
Part 1 measures the pupil’s usual rate of reading interesting, 
story-type material, as compared with his ability to adopt a 
faster rate of reading and still comprehend comparable mate- 
rial when ho is instructed to vary his rate according to a dif- 
ferent purpose. On both parts of this test a check is made 
on the pupil’s comprehension of the material read. Part 2 
measures the rate at which the pupil usually reads and compre- 
hends social-studies material. Part 3 measures the pupil’s 
usual rate of reading with comprehension, science material. 
These areas correspond to three of the areas of vocabulary 
measurement in Section I. 

Section IV of the tests, entitled Word Attack, measures 
word-recognition and attack skills and has two parts. Oral and 
Silent. Part I, the Oral Test, is the only individually ad- 
ministered portion of the battery. Six graded paragraphs of 
interesting, general-type reading material are read aloud by 
the student. The teacher observes the pupil’s reading attitude 
and methods and marks the errors he makes while reading, 
using a modified method of scoring based upon that of the 
Gray Oral Reading Paragraphs. 

Section IV, Word Attack, Part 2, Silent, attempts a new 
approach to the measurement of word recognition. This part 
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of the test is set up for group administration. Thiough it an 
attempt has been made to measure the ability to hear sound 
by using a matching technique and to test the pupil’s ability to 
divide words into syllables. Remedial techniques along these 
lines can be used profitably to improve the reading skills and 
also the spelling proficiency of some pupils, and remedial ex- 
ercises are already available which classroom teachers can use 
successfully.^ It is not yet known how such skills are related 
to the total reading process, but tbis is being studied. The 
instrument we have built is, however, a reliable one. 

From this battery of diagnostic tests it should be possible 
for an instructor to select tests for use with the pupils whose 
reading development is unsatisfactoiy, to determine what skills 
are inadequate and why the development of their reading has 
not kept pace with what would be ordinarily expected With 
the aid of such diagnostic tests, and other information concern- 
ing the individual, classroom instructors should be able to 
undertake remedial instruction, with at least some of their own 
pupils. 

There are a number of areas in which diagnostic tests might 
have been set up. However, the Committee, in studying the 
pioblem, had in mind that the results of the tests should pro- 
vide immediate clues to remedial instruction. Therefore, in 
building the tests, initial attention was given to those basic 
areas where remedial work has already proven to be successful. 
However, they did not include tests measuring specific skills 
such as graph-reading because this skill, while important to 
efficient, critical reading in the higher grades, can usually be 
taught in a session or two of group work after good basic read- 
ing skills have been developed. Unless a student has the es- 
sential basic reading skills, the abilit}'' to read graphs will not 
greatly profit him. Therefore, they did not consider measuring 
such specific skills the most efficient use of testing time, though 
a teacher might undertake it as a classroom technique in group 
reading instruction. 

The Committee has been asked why the tests were not con- 
structed along lines seemingly indicated by factor analyses of 
reading skills. The answer is that while in the future the 

® Tnggs, Frances Oralmd Improve Your Spelling. New York Farrar and 
Rinehart, 1944. 
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Committee is very much interested in any research which will 
advance the measurement of reading, its main immediate con- 
cern is to aid in reducing the lag between what is now known 
concerning the teaching of reading and what is done in the 
secondary grades and college. From this point of view, it 
seems better to measure the groups of skills basic to develop- 
mental reading which we know the peisonncl worker and 
teacher can do something about than to measure pure factors 
(supposing we found we could do so practically in the average 
class room) and then not know how to approach profitable in- 
stiuction along the lines the mca.suremenL dictated. Which 
appioach would bring the desiied results most quickly may be 
debatable, but the reasoning of this Committee early led it 
to discard the factor analysis appioach. It is undoubtedly 
true, however, that members of the Committee expect and will 
rejoice if, through the approach they have taken, dictated by 
practical consideration of immediate needs, comes a better sci- 
entific understanding of the reading process and ways of mea- 
suring puic factors basic to reading, and peihaps a better un- 
derstanding of their development through the educational 
process. 

All tests constiuctcd for the pielimlnary experimental 
edition were subjected to the u.sual item validation techniques 
and reliabilities were checked. All tests were given to the 
same students in oidcr that intcrcorrelations of all parts might 
be lun. These data were then studied and a selection of ma- 
terial for the final experimental edition was made. This edi- 
tion was again subjected to analysis using the same item vali- 
dation techniques. Ileliabilities were again run and intercor- 
rclations with a general measure of ability were computed. 
From these data available on the second experimental edition, 
the final edition of the te.st.s was constiuctcd. 

The Survey Section, and Section IV, Word Attack, Part 1, 
Oral, and Part 2, Silent, went on sale September 1 and were 
distributed by the Fclucatlonal Records Bureau, a nonprofit 
educational organization, in New York. All other sections of 
the diagnostic battery will be available June 1, 1948, from the 
same source. 
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The Committee is now incorporated as a nonprofit mem- 
bership corporation under the laws of the State of New York 
for the purpose of research in testing and the use of test results 
in remedial and developmental reading piogramSj and in aiding 
schools to better utilize the results of such research, tests and 
remedial aids as are available to them. 

The remainder of this paper indicates some of the research 
which has been done and the research now pending. This out- 
line of projected research will, of course, be expanded and modi- 
fied as the work develops. 

The Survey T est is intended as a screening test to be used 
with all students and was built to measure a composite of the 
most usual types of reading skills necessary for use in school 
work. Certain types of data are now available on this test 
which are indicative of its validity for use as a screening test. 

The vocabulary and subject matter used in the test, are of 
the nature which students regularly meet with in school. Com- 
prehension questions were constiucted with a view to measur- 
ing mam ideas, details, and reading of a critical nature. 

From an administrative point of view, a test of this nature 
needs to be so constructed that testing time is efficiently used. 
Average validity coefficients of the 100 items in the test are: 
Form A, 54; and Form B, S3. Average percentage of difficulty 
of the items for ninth-grade students is about fifty-four. 

The Suwey Tests were given to approximately 3,000 stu- 
dents in seventeen schools of wide geographical distribution to 
establish tentative percentile and grade norms. Reliabilities 
estimated by Kuder-Richardson Formula 21 at each grade 
level indicate that the total comprehension score is a reliable 
measure. The average of coefficients obtained is .90. The 
average of coefficients obtained for rate of reading scores is 
.80. 

Part-score norms are being furnished on this section of the 
test in order to provide clues for judging which sections of the 
diagnostic battery should be administered. However, because 
It was thought important from an administrative point of view 
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to restrict testing time to one class hour on the Survey Test, it 
was not possible to include enough items of each type, compre- 
hension check on rate of reading, vocabulary, and compiehen- 
sion of textbook-type matenal, to make these scores completely 
satisfactory for diagnosis in individual cases. The diiections 
for administering and interpreting this test warn against using 
them for that purpose. 

Plans for lesearch include the investigation of certain re- 
lationships, suggestive of validity, such as- 

1 Relationship to verbal and quantitative scores on a 
well-established test of general ability. 

2. Extent of progress made from test to retest when usual 
type of instruction in reading is given over specific periods of 
time. 

3. Extent of progress made from test to retest when well- 
defined types of remedial instruction are given. 

4. Relationships to other well-established survey tests. 

The diagnostic sections of this battery were set up after 

making a survey of the types of test data specialists in remedial 
reading felt they needed on which to base remedial instruction 
and after surveying the areas in which it has been found that 
successful remedial instruction can be done. 

Section I of the diagnostic battery is a vocabulary test made 
up of five parts, each yielding a reliable score: general vocabu- 
lary, vocabulary of literature and English, of mathematics, of 
physical sciences, and of social sciences. The area in which 
items were placed was determined by use of word lists. Each 
item presents the key word in context. The correct response 
is a synonym of the word as used in the context in which it is 
presented. The test is untimed in order that scores on it will 
be indicative of the maximum ability of the student. The sub- 
ject areas in which vocabulary is tested correspond (except for 
mathematics) to the areas in which measurement is made in 
comprehension and rate of reading. 

Items for Section I, Vocabulaiy, have been validated, but 
since norms are not set up, not much statistical data can be 
reported at this time On the preliminary form intercorrela- 
tions between part scores were high. Correlations with a meas- 
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ure of general ability (the Terman-McNemar Group Test) ap- 
proximately .68. Correlations with word lecognition as meas- 
ured both orally and silently were generally low. 

This section of the test will be useful with students deficient 
in the technical vocabulary needed for efficient reading in the 
several areas measuied. While it is known that it is very hard 
to show improvement on vocabulary test scores tliiough reme- 
dial work in general vocabulary, aid in specific areas does seem 
to bring both measured improvement and helps to establish 
techniques for obtaining meanings from strange words. This 
section of the test is m final form. Norms are being set up and 
the Vocabulary Test will be ready to go on sale in June, 1948. 

A great deal of work has been done on the Comprehension 
section of the diagnostic battery. Those who have worked in 
this area know the difficulties of constructing tests in this area. 
Comprehension of material lead, as usually tested, is closely 
related to general ability as measured by our so-called scholastic 
aptitude or general ability tests. Both types of measures are 
closely related to cultural background. The Committee is 
aware that the measurement of ability to comprehend as 
against actual comprehension should be distinguished because 
potentiality for comprehension is an important factor in re- 
medial work. How can it be determined, using paper and 
pencil techniques, to what extent these measures are affected 
by these two factors? In this battery, an attempt has been 
made to differentiate the factors by varying the method by 
which the material is presented Comparable material is read 
by the students and is read to them. It is not known, however, 
to what extent listening is a learned skill. Since listening to 
material being lead aloud is not the usual technique used by 
students m preparing textbook assignments, such additional 
factors as concentration, skill in attack on new words, etc., 
may result in these two appioaches measuring somewhat dif- 
fering processes. Much research will have to bo done along 
this line, even after the technical difficulties of constructing 
this section are surmounted. 

It was also requested by persons doing remedial work that 
the Comprehension Test give reliable and valid subscores on 
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such factors as ability to obtain the main thought of a passage, 
ability to support the main thought by details as presented by 
the author, ability to distinguish between important and unim- 
portant details as given. Some would also like to be able to 
distinguish these skills as applied to clearly defined types of 
content such as social science, science, and literary material. As 
yet, our finding is that it ha.s not been possible to distinguish 
between such factors when measured — in other words, correla- 
tions of scores on items of good validities are so high as to make 
it questionable whether any distinction is, in fact, being made. 

Section III of this batteiy measuies, to the extent that the 
instructions actually cause students to respond m the manner 
indicated, the usual rate of reading with understanding mate- 
rial of a general story- type, material utilizing social science 
vocabulary and concepts, and material utilizing physical sci- 
ence vocabulaiy and concepts Data from this section, along 
with data from other sections of the diagnostic battery, espe- 
cially vocabulaiy, give impoitant clues foi remedial work. 

The first part of Section III docs more than measure the 
“usual” rate at which students recall and comprehend the 
material presented. That is only the first task piescnted to 
the students. After their “usual” rate of reading is measuied 
on a passage using material of a general story-type, they are 
presented with material comparable to that of the first pas- 
sage with instiuctions to read it as fast as they possibly can 
and comprehend it. Thus, by comparing the scores a student 
makes on the first and second passages, it should be possible 
to get some clue as to the extent to which he is flexible in 
applying his skills, a very imiiortant factor in efficient, all- 
around reading. Is the technique adequate to our task? The 
answer is not yet known. Only fuithcr carefully controlled 
research will tell. 

Another question has been raised. Ability to skim as a 
reading skill makes for flexibility in reading. To what extent 
does this latter approach measure skimming as against more 
thorough reading? Perhaps the extent of comprehension, given 
equal pievious knowledge about both passages, will help to 
answer this question. 
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Another possible approach to controlling the actual reading 
process more closely would be to set the stage by raising cer- 
tain questions before the passages were read, the answers to 
which students would read for. The process might even be 
more closely controlled by presenting the student with ques- 
tions on the topic covered by the passages before he reads them, 
for perhaps we are assuming his comprehension comes from 
reading, when actually it comes from previous knowledge. 
Such questions might be presented some days before the 
actual “reading” test was administered if presentation of the 
questions was thought to affect the reading process in a manner 
not consonant with the purpose of the test. 

The literature is not by any means devoid of research re- 
ports on the relationships existing between the various factors 
related to the rate at which material is read and other measured 
reading skills. However, all of the factors measured have not 
always been carefully controlled. Therefore, much can be 
added to our knowledge in this area. It is expected that tests 
in this Section will also be ready for sale by June, 1948. 

The last general area in which tests are now set up in the 
diagnostic battery includes word attack and word recognition. 
It is perhaps justifiable to say that basic to all reading is the 
ability to recognize word symbols previously learned and the 
skill in attacking words not so recognized. There are a num- 
ber of ways in which a thought can be obtained. No person 
can be an efficient reader unless he has some skills for attaining 
thought from unknown words. He must know how to obtain 
meaning from those whose configuration alone give no clues. 
It is these skills which the Word Attack, Section IV, of this 
battery of tests measures 

It has long been agreed that a significant value of oral 
reading is to test these basic reading skills and the pupil’s 
methods and attitudes of approaching reading. Through anal- 
ysis of errors of mispronunciation, omission, confusion of words 
of like configuration and such factors, the reasons for inaccurate 
comprehension may become apparent when otherwise only the 
fact that comprehension was inaccurate may be the only thing 
recognized. Therefore, the battery provides an oral reading 
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test of six graded paragraphs carefully controlled from the point 
of view of interest, vocabulary load, length, etc. These are 
presented orally to the testce and errors of various types are 
recorded according to a somewhat usual standardized practice. 

A great deal of research needs to be done with the data 
that such a test will provide. For instance, we do not yet know 
whether secondary-school giade norms on this part of the 
test are needed, for present evidence suggests that there may be 
as much vaiiabihty within giades as between grades and that 
there is not much change in these basic skills at successively 
higher grade levels. It was not known to what extent these 
types of errors could be reliably measured and therefore their 
use justified in differential diagnosis and remedial work, until 
results were in from the experimental edition which showed 
reliability of scores in approximately 100 Cleveland ninth- 
grade pupils of over .90* 

The question also aiiscs as to whether the approach a stu- 
dent makes to words known or unknown to him might better 
be revealed by piescnting to him words in list form rather than 
context, for context does present an uncontrolled variable. 
Therefore, at present our word attack test also provides three 
word lists to be pronounced. Research will be done in order to 
determine the extent to which cither one or both measures are 
getting at what the test is purporting to measure. 

It seems possible to measure certain word recognition skills 
by group techniques rather than by oral, individual presenta- 
tion, thus perhaps controlling the situation more closely and 
also utilizing testing time more efficiently. Therefore, Part 2 
of the Word Attack Section, utilizing a matching technique, 
attempts to measure the ability of the student to hear sound, 
it being concluded that ability to sound words is one factor in 
approaching a strange word. This pait of the test also meas- 
ures the ability of students to divide words into syllables. 

The relationship which these last two skills have to related 
skills as measuicd by oral reading and by the skills measured 
by other sections of the test is almost unscratched from the 

* By checking errors in odd vs. even lines and using the Spearman-Brown for- 
mula. 
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point of view of research. We do know that students who 
cannot divide words into syllables or who cannot hear sound, 
or both, when taught these skills make immediate and sur- 
prising piogress in many phases of reading. But this is a 
non-St atistical validating technique. From a statistical ap- 
proach about all we know is that this measure as constructed 
is a highly reliable one and that coi relations between it and 
other tests in the battery when in experimental form ranged 
from zero to .60, with other sections of the Word Attack test, 
and about .50 with vocabulaiy and other sections of the 
battery. The range of correlations with outside criteria such 
as a group test of general ability and vocabulary, comprehen- 
sion as measured by scores in another survey type reading test, 
was about the same. It is therefore apparent that there is 
as much room for fruitful research to be done on this part of 
the test as upon the others. 

This battery of tests affords a great many possibilities for 
a more exact definition and measurement of reading skills and 
for measurement of growth in reading. Such instruments are 
needed if reading is to serve efficiently as a tool in the greatest 
task we face, that of helping each member of societies the world 
around to make his contribution to a lasting peace. 



rilE ESSAY EXAMINATION IS A 
PROJECTIVE TECHNIQUE 

VERNER M. SIMS 
University of Alabama 

In spite of more than three decades of ciiticism (one might 
almost say abuse) by educational measurers, the essay ex- 
amination continues today strong and healthy. In the face of 
a long contention that it does but poorly what the short- 
answer or so-called “objective” test will do better, even today 
probably more of the achievement testing used by teachers, at 
least at the upper levels of the educational system, is of the 
essay rather than of the “objective” type. Such vitality cer- 
tainly suggests some uniqueness of function on the part of the 
essay examination, however vaguely and inadequately this 
function may have been identified. And, by and large, it 
seems safe to say that this type of examination has been used 
uncritically, without any very clear realization of its functions 
and without much effort to improve its measuring qualities. 
This paper represents an attempt to identify and to define 
more clearly what appears to be a unique function of the essay 
examination, to the end that later research and investigation 
may lift its use to a more critical and therefore more helpful 
level. 

Although the fact has not yet been noted in the literature on 
educational measurements, it seems clear that in a scheme of 
human measurements, the essay examination would properly 
be classified as a “projective” method of measurement. Since 
projective methods, as such, are relatively unknown in the field 
of achievement testing, some justification of this statement 
appears to be In order. Let us begin by trying to identify 
projective techniques. 


16 
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Frank, who seems to have introduced the word projective 
method into the psychological literature, defines the, term as 
follows: 

A projective method for the study of personality involves 
the presentation of a stimulus situation designed or chosen 
because It will mean to the subject not what the experimenter 
has arbitrarily decided it should mean (as in most psycho- 
logical experiments using standardized stimuli in order to be 
objective) but rather whatever it must mean to the person- 
ality who gives it, or imposes upon it, his private, idiosyncratic 
meaning and organization ( 3 , p. 403 ). 

As the name implies, projective tests involve problematic 
situations which permit (almost require) the testee to “project” 
his personality into his answer. Such methods are commonly 
contrasted with “objective” or short-answfer testing. The 
media in use for projective testing may consist of such organ- 
ized materials as personal documents, dramatic or artistic 
forms, and constructions; or they may consist of relatively 
“unstructured” materials such as ink blots, finger paintings, 
and even the free use of cold cream. 

The test situations arc chaiacterized by a considerable 
“freedom of choice” on the part of the testee, and by the rela- 
tively complex nature of the response demanded. Rather than 
pre-detei mined "right” responses which must be recognized or 
recalled in order to do well, in projective testing the testee is 
compelled to make choices in terms of his own experiences and 
sense of values. 

The concern of the tester is typically with the “pattern” of 
response made rather than with a single summation of “right” 
choices, hence information concerning the “why” and the 
path of choice is available. Both the “manifest content” 
made intentionally in response to the problematic situation, and 
the “hidden content,” reflecting expressive and stylistic per- 
formance and unintentionally revealing aspects of the mental 
life, are considered legitimate data from which to draw infer- 
ences concerning the personality of the testee. Thus inferences 
concerning characteristic ways of behaving’* or psychological 
dispositions are drawn from both classes of data. In fact, 
many users of projective methods consider the “hidden” con- 
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tent as the more valuable source of insight. Finally, projective 
testing is done more commonly for the undeistanding which it 
furnishes of the individual personality than for “noimative” 
purposes. 

I'hc reader who cams to try it will be amazed at how 
neatly the concept of the essay examination can be inserted into 
the above chaiacterization of projective methods. The best 
definition of this type of test which the writer has been able 
to produce is almost a paraphrase of Allport’s definition of the 
personal document (1, p. 12), which he recognizes as a type 
of projective method: 

The essay exami7iation if a relatively free and extended 
written response to a problematic sit nation or situations ( ques- 
tion or questions) , which intentionally or unintentionally re- 
veals information regarding the structure, dynamics and func- 
tioning of the student’s mental life as it has been modified by 
a particular set of learning experiences. 

The necessity to biing to bear the “higher-order” aspects 
of one’s learning and the need of a relatively complex and, 
therefoie, long answer in order to do this has been fairly well 
recognized and defended by users of the essay question. 
Clearly the essence of the difference between essay and ob- 
jective tests is in terms of the freedom and extended nature of 
the lesponse m essay testing. The unintentional revelations 
which essay answers have for the “initiated,” although not too 
consciously recognized, have also been an important factor in 
the continued popularity of the instrument, 

One element in the definition given does seem to assure the 
legitimacy of the essay examination as a test of educational 
achievement and, at the same time, to point out its uniqueness 
as a projective technique. This clement, contained in the last 
phrase, is the concern over the “structure, dynamics and func- 
tioning of the student’s mental life as it has been modified by 
a particular set of learning experiences.” This is not the pur- 
pose for which projective testing has been used; but it is the 
end which all educational measurements commonly attempt to 
serve. And incidentally, it is an end which many teachers feel 
is not too completely served by the atomistic and oftentimes 
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supeificial measurement which results from short-answer test- 

ing. 

To identify the essay examination as a projective method 
may perhaps but strengthen the conviction of many educational 
measurers that the instrument occupies an unhappy place in 
any scheme of psychological testing. On the other hand, to 
so classify it seems to define more clearly those eharacteiistics 
of the instrument which have heen involved in its defense hut 
not recognized too well by its defendeis. Moreover there is 
a growing conviction on the part of many that projective test- 
ing has an important part to play in psychological vScience, a 
conviction that the critical and intelligent use, of projective 
methods furnishes insights which arc not available (and hy the 
nature of things cannot be available) in the data furnished by 
restricted responses to “objective" questions. 

One has but to examine the recent literature to appreciate 
the place that projective testing has come to take in the re- 
searches on psychological measurement. Sargent, for example, 
in a recent review of literature on the subject li.st.s' a bibliog- 
raphy of 274 titles most of which have been publi.shed in the 
last few years (4). It is important ahso to note that a number 
of investigators have subjected projective methods theiiLselves 
to careful study, with the result that, to a degree at least, a 
critical and intelligent use of them is now possible. 

If it is accepted that projective methods do have a useful 
place in human measurements, identifying the essay examina- 
tion as such a method makes it immediately possible to suggest 
applications of the findings concerning the critical use of such 
instmments already at hand from the general field of projective 
measurement. Ultimately, it should lead to the development 
of essay testing as an important and legitimate part of the 
general field of projective testing. 

The remainder of this paper represents a first attempt at 
the former of these tasks. In suggesting procedures for using 
the essay examination we shall lean heavily on Allport’s The 
Use of P ersonal Documents in Psychological Science ( 1 ) . The 
truth is, the writer’s “insight” relating to this problem came 
chiefly as a result of reading Allport’s monograph which might 
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well become “required reading” for students in the field of edu- 
cational measurement. 

The reader will appreciate the fact that the suggestions 
offered here arc to be accepted as tentative. That is, they are 
generalizations from the field of projective measurement which 
are as yet relatively untried in their application to the specific 
field of essay testing. They do, however, appear as reasonable 
hypotheses worthy of being tested in piactice. The suggestions 
fall naturally into three classes: (a) those lelating to the kinds 
of outcomes to test for; (b) those relating to the nature of the 
test questions; and (c) those relating to the handling of test 
data. 


I. Suggestions Relating to the Kinds of Outcomes 
for the Measurement of Which the Essay 
Examination Is Suited 

Indiscriminate and uncritical use of the essay examination, 
preparing questions without carefully identifying the learning 
outcomes concerning which evidence is being sought and with- 
out thought as to the suitability of the essay-type question for 
securing such evidence, has undoubtedly been common. All 
too often the accusation that essay testing is the lazy man’s way 
of doing it seems justified. Intelligent use of the essay exami- 
nation demands that we first isolate the particular outcomes of 
learning for which we wish to test and then that we inquire as 
to the appropriateness of this instrument, along with others, for 
doing the job. The following suggestions should help with 
this task: 

1. The essay examination appears to be particularly well 
suited for obtaining evidence relating to certain “higher-order” 
intellectual outcomes of education. 

Although most essay testing actually done is probably pri- 
marily concerned with the recall of infoimation learned, the 
value of the essay for testing ability to organize, relate, and 
“weigh” materials learned has been long appreciated. These, 
however, are but a few of a number of higher mental processes 
for which the test seems well adapted. To name others, where 
the concern is over the extent of which particular learnings are 
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integrated with previous learning, over the “distance” that par- 
ticular learning can be transferred, or with the ingenuity of 
response (the ability to use learning creatively), the essay ex- 
amination seems called for. Although clever recent develop- 
ments in short answer testing suggest that some of these 
outcomes may be susceptible to “objective” measuiement, to 
date It seems to be chiefly to the essay that we must turn for 
information in these fields. In cases where information on the 
“path” of solution followed voluntarily and wnthout suggestion 
is desired, such as is involved in the “elegance” of solutions in 
mathematics, the free situation provided in the essay examina- 
tion seems required. And, finally, when we want to know the 
“frame of reference” with which a student approaches problems 
(information which becomes highly important when we undei- 
take to predict whether he will me his learnings), the freedom 
of the essay is demanded. Objective tests, with their predeter- 
mined “right” responses predeteimine also the fiamc of refer- 
ence with which the student must approach the problem. 
Contrast, for example, the objective question beginning, “What 
' scientific principle is involved in the following situation?” with 
an essay beginning, “What would you do in the following situ- 
ation?” Nor, if we want information on whether a student will 
use his learning, do we get it by converting the above essay 
question into an objective test with alternate choices! What 
we want to know is how he approaches the problem voluntarily 
and without suggestion, 

2. Inferences concerning certain personal-social learnings 
are perhaps best drawn from the kind of data obtained through 
essay questions. 

In a sense one might say that the usefulness of the essay 
examination varies directly with the breadth of the responsi- 
bility assumed by the teacher. If the end sought in teaching 
is changed behavior on the part of the learner, then the funda- 
mental question in all educational testing is: Can we, in terms 
of the evidence at hand, predict that the learner will act differ- 
ently in a certain class of situations? Once the matter is stated 
in this manner it becomes evident that adequate testing will 
always comprehend more than ability to do. Whether one will 
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act so and so depends not alone on whether he can do so but also 
on a complex of atlitudinal-emotional-motivational factors 
which may be loosely called personal-social in nature. A com- 
prehensive testing program will include data fiom which in- 
ferences concerning these learnings may be drawn. It is heie, 
perhapSj where essay examinations, along with other projective 
methods of measuring the outcomes of learning, have then- 
greatest usefulness. The freedom and complexity of the essay 
typically require the testee to bring his own “sense of values” 
to bear on the task-provoking situation. In the well-planned 
question the respondent not only does but must reveal informa- 
tion which is pertinent to any predictions concerning how, when, 
and where the abilities he has acquned will be used. 

Furthermoie, many teaching situations today aie con- 
sciously planned not as means for intellectual development but 
for the purpose of modifying attitudes or rebuilding emotional 
patterns. In this teaching cuiriculum experiences are built 
directly and immediately out of the purposes and goals of the 
individual learner In such situations the essay in some of its 
manifestations seems to be the only “paper-and-pencil” testing 
technique available. The varied and highly personal nature of 
such learning can only be revealed through a “personalized” test 
situation, and even then oftentimes only through the “hidden” 
content. 

3. By and large the essay examination would seem to be 
more useful for the information which it reveals concerning the 
individual than for “normative” purposes such as are commonly 
involved in “grading.” 

Where “grades” are interpreted as expressions of relative 
position in a class, essay examinations can probably be so used 
as to be reasonably dependable. In fact, it has been proposed 
that the basis for making a decision concerning whether to use 
objective or essay tests should be economy of time for the 
teacher — in small classes the essay would be the more econom- 
ical; in large classes, the objective. In general, however, this 
writer is not convinced that the particular forte of the essay 
examination is for purposes of grading or as a final examination. 
Instead, its strength seems to be in terms of its diagnostic val- 
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ues. It is in terms of the information revealed concerning par- 
ticular individuals, information which will be helpful in working 
further with these individuals. As commonly used, objective 
tests have a minimum of diagnostic value. Granted that some 
improvement can result from a more intelligent use of them, 
they still have one serious limitation — the information revealed 
can never go beyond that which is anticipated by the test- 
maker. On the other hand, the unique value of the essay is 
often in terms of the unexpected insights revealed; revealed by 
the naive subject in both the manifest and hidden content, but 
revealed, to the initiated at least, in the hidden content of the 
responses of the most sophisticated students. 

As a means of illustrating this point let the reader consider 
what might result from developing a series of doctoral “pie- 
liminaries” which were deliberately and systematically designed 
to get at the intellectual and personal-social learnings of the 
student; to the end that we might get leads to further work with 
him and for him, and with the matter of “passing” or “failing” 
being purely incidental. Suppose, for instance, that the readers 
of preliminary examinations were required to prepare a list of 
suggestions for the further professional development of the 
student, suggestions for him and for those who have responsi- 
bility for his training. From objective tests, if we had enough 
cases to make our interpretations dependable, we might get 
information on what he does or does noi know and can or cannot 
do. We might be able to say that he needs to study more in 
thi.s or that field; or, if we have norms for part scores (and this 
means a still larger number of cases), we might go so far as to 
say that his study should be on this subject or, if our break- 
down was small enough, on this topic. Perhaps, even, if we 
used some of the more recently developed techniques, we could 
say that he needed to acquire understanding, to learn to apply 
principles, to reason logically, or to interpret data, in this field 
or that field. At best, the information revealed through ob- 
jective tests would he limited to the student’s abilities. This 
information is in sharp contrast to the richness of the insights 
concerning his motivations, his attitudinal patterns, and his 
habits of action which could come from well-prepared ex- 
haustive essay examinations intelligently handled. 
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And it is to the credit of the essay examination that we 
cannot predict precisely the nature of these insights prior to an 
examination of the papers. What we can do is to identify 
some of the intellectual and personal-social characteristics which 
we consider important, to plan a variety of free-iesponse prob- 
lematic situations (questions) which appear fruitful for elicit- 
ing information relating to these chaiacteiistics, and then to 
develop systematic means of handling the test data so as to 
make usable whatever information inheres in them. And it is 
such proceduies which need so badly to be subjected to experi- 
mental try-out by our testing experts. 

4 Finally, it would appear uneconomical, in terms of time 
and energy and in terms of the level of skill demanded in han- 
dling the answeis, to use essay te.sts for securing information 
which can be obtained through short-answer testing 

When large numbers of students aie involved, the time and 
labor necessary for preparing, administering, scoring and in- 
terpreting objective tests is obviously less than that needed 
for essay tests. Furthermore, the level of skill required for a 
good part of the work in handling objective tests (that of 
scoring) is of a low order and can be delegated to clerks or 
other assistants. These facts mean that whenever objective 
tests will do the job, as, for example, in measuring factual 
learning, they are to be preferred. They mean, also, that the 
testei’s skill and ingenuity in objective testing and his facilities 
for such testing become a factor in determining the extent to 
which essay tests will be used. They do not mean, however, 
that we should select for testing only those outcomes which can 
be tested by short-answer methods. It may be that for crude 
classification purposes, such as are involved in a S-point grading 
scale, for example, the correlation among desirable outcomes 
(which are known to exist) are sufficiently high to justify one 
in sampling only those learnings which can be tested objectively. 
Even this appears risky in the face of evidence which is at hand 
concerning the influence that the type of test used by the 
teacher has on what students study and how they do it. Cer- 
tainly when we want to understand the individual and the 
nature of his learning, the economy of short-answer tests is no 
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justification for substituting evidence relating to one outcome 
for evidence relating to another which can be more easily tested! 

11. Suggestions Relating to the Nature 
of Good Test Questions 

The framing of “good” essay questions, (that is, questions 
which do cause the testee to reveal, both intentionally and un- 
intentionally, the nature of his mental life as it has been modi- 
fied by certain learning experiences) is obviously one of the 
most important jobs in essay testing, and one for which leally 
dependable rules will have to await further investigation and 
study However, certain suggestions are proposed: 

1. Essay questions should permit a relatively free response 
and should encourage an extended response. 

In objective testing, it is the rule to limit rigidly the require- 
ments of the adaptive task (question) to the end that there be 
only one “right” response. If essay questions are to be most 
useful as projective instruments, exactly the opposite rule 
should hold. As Allport puts it, “The more exacting the pre- 
scription in terms of task, the less value the instrument has in 
terms of expression or projection.” (1, p. 112.) If we want 
to find out what learning a student will bring to bear on a ques- 
tion which is posed to him, then he must have freedom of 
choice, and the greater the freedom the more chance that valu- 
able insights into his learning will be revealed by his answer. 
Contrast, for example, these two questions: “Discuss the 
Articles of Confederation,” and, “Discuss the Articles of Con- 
federation with respect to their origin, their working out in 
practice, and their relationship to the present federal constitu- 
tion.” The second question is obviously designed to elicit 
specific learnings of a factual nature relative to the Articles; but 
if one IS interested in getting evidence relating to the extent to 
which the student has integrated his readings dealing with the 
Articles with other learnings, or evidence bearing on his at- 
titudes, or on his ability to personally evaluate the Articles, 
then the chances are better with the first question. This be- 
cause of the freedom with which it permits him to project his 
own personality into the situation. 
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Furthermore, within the limits of available time (for taking 
and for reading), the more the student writes, the better. The 
relation between short answers and objectivity is often assumed 
to be so intimate that the terms “shoit answer” and “objective” 
have become more or less synonymous in testing But if essay 
tests are to be most valuable as projective instruments we must 
encourage the student to write at length. If we give him 
enough rope he may hang himself, but he may, too, reveal just 
the information which we need and cannot get through our 
objective testing. We will have to seek agreement among com- 
petent judges not by arbitrarily limiting the response but, in- 
stead, by agreement as to the outcomes concerning which we are 
seeking information and by agreement as to how we will handle 
the test data. That is the only real sense in which we have 
objectivity in educational measurements anyway. 

2. Generally, essay questions should pose pioblems, and 
problems that have a “reasonable” separation from the original 
learning situation. 

Essay questions which call for the uncritical recall of facts 
learned or questions for which the students have been directly 
coached (types of questions which are too common) seem 
scarcely worth mentioning. But aside from these, some essay 
questions put the student in a new situation and one to which 
learning acquired in a different setting must be brought to bear, 
while other questions demand that he respond directly in an in- 
terpretative or evaluative manner to some particular learning 
experience. Illustrative of the first would be “problems” in 
mathematics, new situations involving principles learned in 
science, new situations in which attitudes may (or may not) 
color the response, situations demanding critical choice from 
total materials learned, etc. The second type would be exem- 
plified by questions beginning with such phrases as: “Tell the 
story of,” “What is your opinion of,” “What do you think of,” 
“Tell what you know about,” Psychologically these questions 
are “free-responses,” and as such have their value; but they 
furnish only limited (and indirect) evidence concerning the 
extent to which a student will transfer his learning. Generally 
speaking, it would seem better to use the “new situation” type 
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of question. When using it, however, one mu.st remember that 
the extent to which one transfers learning always has some 
outer limit; and, consequently, the sepaiation between the 
original learning situation and the test situation should be 
reasonable. (See 2, pp. 48-54, for a good discussion of this 
point.) 

3. Essay questions should call for truly personal answers. 

For most purposes, questions so framed that what the 
teacher wants is obvious, those which call out a desire to please 
the teacher, those which stir the “unfettered artistic imagina- 
tion,” or questions where there is external compulsion to an- 
swer in a certain way (either literal compulsion or compulsion 
through appeal to prestige, conventions, or morals) will fur- 
nish data of limited validity. If we are seriously seeking evi- 
dence bearing on fundamental changes in students, then ques- 
tions which we ask them must be accepted as peisonally “real,” 
“practical,” and “honorable,” Fiuthermore, the questions 
must give the impression of being susceptible of adequate treat- 
ment in terms of the student’s own set of values. Testing here 
is very intimately tied up with teaching. The teacher who is 
too prone to express his own views in a forceful answer or one 
who dogmatically tells his students what is what on many is- 
sues, can expect little other than memory for what the teacher 
has said to be revealed through free responses to these issues. 

4. The questions should be framed so as to encourage the 
testee to use his own “frame of reference,” to reveal the “path 
of reasoning,” to show reasons for choice, and defend positions 
taken. 

This is another way of saying that the emphasis in essay 
testing should be on judgment rather than on memory, on hozu 
and why rather than on what, on process rather than product, 
on means rather than ends. What? Where? When? Who?; 
These are questions to be answered objectively. Explain, com- 
pare, contrast, evolve, assume, evaluate, justify, trace, prove, 
formulate: These words suggest situations which may involve 
true essays. (Although, as has already occurred to the reader, 
even these may call for nothing more than rote or semi-rote 
reproductions of materials to be given back to the teacher.) 
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5. Reliability should be sought through “depth” sampling 
and thiough paying particular attention to the representative- 
ness of the samples. 

The assumptions undeilying the piinciple commonly ac- 
cepted in objective testing that leliabihty is secured through 
using a relatively huge number of independent items would not 
seem to hold for essay testing if it is used as a projective tech- 
nique. Instead, it secm.s that the kinds of evidence on learning 
we seek through essay testing would be more dependably re- 
vealed thiough encouraging the student to “dig in” on a rela- 
tively few subjects rather than to react superficially to a large 
number of questions. This is not to imply, of couise, that 
reliability in measuiemcnt is not important in essay testing. 
In fact, the variety of inferences which may be drawn from 
essay data (as compared with the single infeience typically 
drawn from objective tests concerning the noimative position 
on a total score) demands that particular attention should be 
paid to reliability. It docs mean, however, that we cannot un- 
critically transfer to essay testing the “piinciples” determining 
reliability which have been evolved in objective testing. The 
emphasis probably should be placed on the lepresentativeness 
of the sample. Experience in other fields with limited samples 
carefully chosen offers encouragement. In opinion polling, for 
instance, Roper in the Fortune polls, has demonstrated that 
relatively small samples which are highly representative may 
be more reliable than large samples not so well chosen. 

III. Suggestions Relating to the Handling of 
Answers to Essay Questio7is 

The reader who has" followed our discussion to this point 
will realize that in the case of answers to essay questions one is 
dealing with highly complex data, and data which require con- 
siderable skill in handling if dependable inferences concerning 
learning arc to be drawn fiom them. Furthermore, it is with 
some hesitation that the writer offers any suggestions in a field 
that has been subjected to so little experimentation. Perhaps 
the most appropiiate recommendation would be to the effect 
that we should deliberately and systematically investigate the 
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problem of interpreting (that is reading, grading, or scoring) 
the essay examination as a projective technique. Expeiience 
with projective methods elsewhere, however, does indicate that 
the following suggestions are woith consideration: 

1. To the extent possible, in evaluating essay answers we 
should use an inductive method; that is, we should examine the 
data and then evolve a “frame of refeience” fiom which to treat 
them. 

The reader’s own purposes and values are sure to play a 
part in determining the plan finally developed for handling the 
data (as is true in evaluating any measurement), but their role 
will be a more legitimate one if they are introduced after a pre- 
liminary examination of the papeis. One who appioaches a 
set of essay answers with a fixed conviction as to what he should 
find, is defeating, in part at least, the legitimate purpose which 
the test serves In fact, one might venture the suggestion that 
when one can legitimately piedetermine the right answei one is 
dealing with learning that should be tested for by objective 
means. 

2. In reading essay examinations, look for and carefully dis- 
tinguish between the manifest and the “hidden” content; be- 
tween data which reflect learning resulting from particular cur- 
ricular experiences (influence of the course or courses) and 
those which reflect the general personality of the student; and 
between the data themselves (the answers) and the inferences 
which one draws from them. 

The content, conceptualization, and insights consciously 
written into a paper are obviously important; but such matters 
as the style, omissions, rationalizations, or attitudes which are 
unintentionally introduced into the treatment may be just as 
revealing. If tests are designed to furnish evidence relating to 
the outcome of some particular learning experience (as is true 
in most of our teacher-testing) one must recognize, however, 
that not all of the evidence revealed through a personal docu- 
ment such as an essay answer is relevant to the task at hand. 
If the question is a real and vital one to the testee, then his total 
personality enters into his answer; and in achievement testing 
it commonly becomes the job of the reader to sort out that 
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which IS the lesult of specific learning from that which is a re- 
flection of his geneial personality only. Finally it would 
appear extremely easy for the careless reader to confuse the 
evidence (what the student actually writes) with the interpre- 
tations (what the reader infers from the answers). To do so 
can only encourage one in “going beyond the data” to an ex- 
tent that IS unjustified. 

3. If other readers are to agree with one’s evaluation of es- 
say answers, in fact, if at a later date one is to agree with one’s 
own interpretations, it is necessary to, (a) identify in a clear- 
cut manner exactly what is to be looked for, and (b) develop 
an organized and systematic method for observing the data 
and drawing inferences from them. 

It is only through the above process that we get the agree- 
ment of judges (objectivity) in any psychological measure- 
ment. In the highly complex and revealing data which one 
gets in essays this is not the simple matter that it is m short- 
answer testing, where it is iclatively easy to get acceptance, 
often uncritical acceptance, of our “rules for scoring and inter- 
pretating ” Nevertheless this proce.s's is necessary if one is to 
justify his interpretations of essays to others. As the reader 
in all probability has already guessed, the writer does not sub- 
scribe to the current fetish for objectivity in teachers’ measure- 
ments. A part of the disagi cement among “competent judges” 
is entirely justified for the simple reason that different teachers 
commonl}'’ seek entiiely different outcomes through their in- 
struction. Another large part of the disagreement results sim- 
ply from the fact that readers “play the game by different 
rules,” a fact which may or may not be justified. However, it 
is only through repeating the examination of and interpreta- 
tions of answers under the same conditions (that is, where 
readers look for the same things and handle the data in the 
same manner) that we are able to get information on the errors 
in our interpretations, and therefore, to get evidence on the 
dependability of our evaluations. 

4. Normally, essay papers should be read for the informa- 
tion which they reveal concerning the learning of individual 
students. 
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The cmtccime of csA.iv ttstin}; will iisti.tlh/ hr chu's to and 
suggestions for further work with partietilat tfnd* ots. Perhaps 
it may be (lesirahle for ilu- r«.Hh r to po jt.io' a eiinunary state* 
ment or a protile for earli stmlutt. mihtihag sh<" significant 
points in the answer atul the infejrtues <{r.»sn Irom them. 
Certainlj', we .shmiltl avoiil simple smnmanons or a “counting 
up” of olrjeciive facts. To tio so ohs ionslv hiih s ilu* most im- 
portant information revealed by the tests. 

5. If gratic.s must he tleterinined ftom an t xamin.uion of the 
papers, it is probably best, after rea<hng. to identify the modal 
pattern of response and to elassify the devi.iies into categories 
ranging along some continuum (or contimia). 

The writer's own experience with essav tests leads to the 
conviction that in any considerable group ui essay answers such 
categories do exist and can be airangeii in a hieiaiehy to which 
grades may he assigned. Sometimes it may he necessary or 
desirable to cla-ssify the an.swer.s more than once and along dif- 
ferent continua, in which case grades may he ariived at through 
a process of averaging. When doing tins averaging, it is 
usually desirable to give added wcigiii to the extiemrs. (The 
writer has used, arbitrarily hut to advantage, weiglit.s of 10, 7, 
S, 3, 0 in a S-folcl classification.) In some cases it may he pos- 
sible to develop a check sheet, a lating scale, or a set of objec- 
tive questions for the use of the reader in evaluating each essay. 
Such devices are susccptilrle to quantification and have been 
found useful in getting a more dependable summary evaluation 
of complex behavior or the products' of work in other fields. 
For ordinary purposes of grading, however, where only crude 
classification is demanded, the labor involved in developing 
such instruments would scarcely seem to he justified. 

(These suggestions arc not to deny, of course, the po.s'.s'ihility 
of a supplementary treatment of essay data in some such ob- 
jective manner as that reported by Stalnaker as being in use 
by the College Entrance Examination Board (S ) .) 

6. And in conclusion, a woid of caution: Beware of too 
broad generalizations. 

Essay answers are records of behavior which we propose to 
interpret as signs of “characteristic ways of behaving.” By 
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the nature of things, however, they are sure to be limited 
samples; and, thcrelore, conclusions drawn from them about 
the psychological make-up of students must be tentative in 
natuie and subject to fuither study. Perhaps the most com- 
mon criticism made of projective testing in general results from 
the tendency of many users of these methods to go too far be- 
yond their data. When the methods are to be used to get in- 
formation bearing on learning, there is an added complication 
resulting from the fact that in the early stages of one’s learning 
behavior is apt to be particularly erratic and inconsistent. In 
consequence, in achievement testing, particularly, dependable 
generalizations can only be anivcd at through an accumulation 
of signs pointing in a given direction. 
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l‘HK NATURE OK VERBAL FLUENCY^ 

BKXJAMIN I-RVaill-.R 
I’nivrrsiity «f Southern California 

I. Inlrodticiioii 

DuRiNct World War IT intcifst was aroused in the effect of 
fluency on reachini; correct solutions to judgment problems 
which arise in crumection with military flying. Questions to 
which answers are needed include: (a) Is fluency an element 
of the judgment process? (fU Is fluency conflned to verbal 
situations or is it a liroadcr function operating m both verbal 
and non-verbal media? 

A prrssible answer trr the latter tpicstion seemed to be con- 
tained in 'rimtsfone's Primary Mental Abilities Battery (8). 
Thunstone analy/.ed a battery of (rfty-seven tests into thirteen 
factorial components, Of the. nine factors that he was able to 
identify, one was interpreted as a word-fluency factor. Analy- 
ses performed since have revealed other fluency factors in tests 
sinrilar to those analyzed by Thurstonc (3, 6, 7). It was felt 
that, since not all of 'riuirstontAs axes had been rotated to posi- 
tions of sinrple .structure and positive manifold (9), and since 
some, of his factors were not identified, a sub-battery of tests 
from the Primary ^leiital Abilities Battery might reveal ad- 
ditional fluency factors, Also, further information concerning 
the facttrrial compo.sition of tests included in Thurstone’s bat- 
tery ha.s been obtained in several subsequent analyses, per- 
formed during World War II, which indicate that (a) vocabu- 
lary tests should have higher loadings on the verbal factor than 
they have in 7’hurstnne’s solution (1), and (b) the spatial- 
relations' and visualization variances should be brought out on 
separate factors ( 1 ) , AH of these considerations indicated that 

iThij paper a a rwwion of 'a thesis presented by th®, ® candidate 
for the M.A. degree at the University of Southern Caluorniaj 
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an analysis of a sub-battery of Thurstone’s tests might fiirtlier 
clarify the problem of the nature of fluency if the final rotated 
positions of the axes weie determined by the principles of 
simple structure and positive manifold. 

In this study fluency is defined as the ease nr speed of 
evocation of original associations and hypotheses, both verba! 
and non-verbal. Woodwoith, in his summary of the experi- 
mental literature on the higher mental processes suggests that 
theie may be two fundamental piocesses involved in solving 
all problems: (a) calling up various acts or responses and (h) 
selecting those responses which meet the requiiements of the 
problem (11). Fluency would be identified with the first of 
these categories. Some English psychologists, among them 
, Brown and Stephenson, use the term fluency to describe a per- 
sonality trait which they measure by the degree of uninliibitcd- 
ness and extraversion (2). 

II. Literature on Verbal Fluency Factors 

Thurstone’s Word-Fluency Factor . — In the first major aji- 
plication of Thurstone’s method of factor analysis, S7 psycho- 
logical tests were given to 240 male college students. One of 
the meaningful factors was identified as a word-fluency factor 
and has the following tests: 


Test Loading 

Anagrams 53-1 

Grammar 530 

Disarranged Words 512 

Spelling SOS 

Vocabulary (Thorndike) 413 

First and Last Letter 388 


Thurstone identifies the principal characteristic common to 
these tests as a fluency in dealing with single and isolated 
words and contrasts it to dealing with ideas and meanings •(«). 

Thurstone and Thurstone’s Iligh-Schnol St 4 idy,—Thm-- 
stone and Thurstone made a second study with 268 high-s‘chool 
seniors as subjects. Thirty-six tests were used. Again a word- 
fluency factor was identified and described as the ability to 
think of isolated words at a rapid rate, They discuss their re- 
sults as follows : 
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f)[Ur of thi' iTiii.sr iiitcrcsimf!; findings in the present study is 
the diMimtinii lutween the verhal-coinprehension factor (V) 
and the sstnd-Hiieiu-v factor l\V) which can be illustrated by 
two of the tests in the [ireseiit battery. Both of these tests 
involvctl .synonyms, hut the test piocedutes were different. 

One of these t<-sts, \'oiMhulary, was an ordinary lecognition 
form ttf vocahnl.u> test in wliieh the subject merely checked 
the resiHinse \Miid \\hich had the same meaning as the given 
stmiiilns syord. 1 liis test had high saturation (/iS) on the V 
factor, whiih accoiinfs foi half the variance of the test. Its 
.satututinn on the W faetor vanishes, (.013). Tins is as we 
.should expect, hcc.iuse the response word.s aie printed in the 
test so that the subject need nnly check the coirect woid. The 
test involves the niuiei, standing of the given wuids, but the 
.subject is not leiiuiied to supply word.s. In oider to featuie 
the W factor, ve included a fiee-recall foim of synonyms 
test. The tist gives a list of common adjectives which are 
easily understood by* all of the .students. They aic asked to 
write thtee svnonvnis for each given word. Here it is not a 
(jiiestion of whether the stuileiit subjects umiei.srood the given 
words, since tlu-v wete ,dl oithnarv adjective.s. 'I'he task was 
to .supply i|inekl\' iluce syiionynis for each given word, The 
test had a high saturation on the W factor (.31) but its satura- 
tion on V vanisbed ( 10 ). 

Thurntun' ^ r Battery , — 'riiornton analyzed a bat- 

tery tif pcr.sistcnce tests to tk'teci a geneial per.sis’tencc factor. 
The stihjects were ISO college .students in a beginning psy- 
chology couise, Xn general factor appeared. Five orthogonal 
factor.s were oiiiainetl and identified a.s (a) withstanding clis- 
comfoit, (h) keeping on at a task, (c) sex difference (or 
strengcli), (d ) feeling of adequacy, and (e) verbal fluency. He 
belitwed the last factor to he between Thunstonc’s two verbal 
factor.s f F aiul IF). 'I’hc* te.sts Thornton used to identify the 
verbal-fluency factor ate: 


7Vof Loading 

Verhiil Ability .712 

Reatlmg Speed - .634 

Word hntlding speed 589 

Nmnber of wnnls Iniilt 382 


Amount read on perceptual test .381 

I’lionutm makes the following suggestions for the further 
investigation of verbal fluency: 
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A question was raised earlier as to whether tiu* flufiicy 
factor is veibal-fluencj' only. 'I'liis ({lastiiuj could he an- 
swered experimentally by a factor analysis of a Icmery of tests 
chosen so as to inchidc some verbal and some non-verbal tasks 
which would give opportunity for the fliu'iicy factor in infln- 
ence the score. 

A more basic question concerning the flueiicy factor is 
whether it is an ability or a predisposition or ;i conihitLitinn 
of the two. Some subjects appear to have a prethspnsition 
to work rapidly and intensely at a task. Is this apparent pre- 
disposition simply a reflection of the ability to wotk rapidly, 
or IS it a separate factor? (7) 

Carroll's Verbal Abilities Battery. — Carroll analyretl a bat- 
tery of 42 tests in the domain of .speech and language brhavitir. 
The subjects were 119 college students. He fmmd Tburstone's 
V factor split into two, pos.s'ibly three factors'. He identified 
two of these as “Richness of the individual'.s' .striek of lingui.stic 
responses” and “The ability to handle .semantic relationship.s," 
No satisfactory interpretation Avas found for the third factor. 

Tburstone’s W factor seemed to split into two component 
factors. Carroll advanced the hypothe.si.s that one of tlie.se fac- 
tors involves speed-of-word as.sociatioa (usually for common 
words) where there is some element of re.striction in the task 
imposed, i.e., where only one or a certain number of re,sponse.s 
from the total reserve arc correct. In Di.sarranged Words, for 
example, the test materials undoubtedly give, rise to a number 
of implicit responses from which the .subject nui.st select the 
correct or acceptable responses. Other tests having significant 
projections on this factor are Suffixes, Form-naming, Word- 
number Memory and Color-naming. 

The other factor seems to involve, in some way, the rate of 
production of meaningful and syntactically coherent discourse 
where there is little restriction to definite responses, Theme- 
word Count, the test with the highest projection on this fac- 
to^ clearly involves facility in producing sentences which arc 
sufficiently meaningful to be accepted by the subject. The 
other tests having appreciable projections on this factor, Gram- 
mar, Similes, and Picture Description (per cent of relevant 
words) seem also to involve an element of syntactical coherence, 
lests having significant loadings on this factor are Suffixes, 
borm-naming, Word-number Memory, and Color-naming (3), 
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Johnson and Reynold's Verbal Abilities Battery .- — ^Johnson 
and Reynolds analyzed prohlein-solving in verbal tasks. They 
started with the assumption that there are two fundamental 
types’ cif activity in prohlem-.snlving: (/’) the flow of various 
acts or ri’sponses, and (.S’) the .selection of these resiponses ac- 
cording to the lequirenients of the problem. They selected a 
battery of ten verbal tests which they believed included F and 
S in varjdng amounts ant! administered them to 113 college stu- 
dents 71 h* test .scores were then correlated and factored by 
Thur.stone'.S’ centroid method. Two factors were obtained. 
The.se were itlentified as /■' and S. Tabic 1 gives the rotated 
factor loadiiiKs ftir this battery. 


T.ABLE 1 

I'itsiil Faclur I'lillfrn uj Johnion and Reynold's Verbal Ability Balisry 


lat 

') Klw ... _ 

2 ('(iiiiplctiiin ...... 

} P.liri‘ii .. 

4. W'lird C’envuiit.. 

.y S;iriu‘ anil Opponitrs 

6. Vctl'.il Ucl.iti'Mn 

7. NcPnii-Ilriiiiy Vncaitiilary . 

8. lirHlfiitcii CVtiiipIrtinn 

!/, iri'iimnn-Nrlvin Iiui'lliRcnn* 
1(1. KcKiiri-Uriiny RwiliriR .... 


r 

.8 

hA 

.$IA 

,024 

"'5X9 

.488 

.115 

256 

..140 

.246 

174 

,418 

.554 

.492 

.204 

,818 

.710 

.220 

.795 

.682 

.143 

,776 

,622 

.007 

,677 

,462 

.210 

,763 

,634 

..tio 

575 

.601 


7'est 9, the Henmon-Ndson Intelligence Test, indicates the 
relative saturation of these two factors in an intelligence test 
( 6 ). 

Cattdl’s Surgency-Desurgency Factor . — Cattell identified 
a Surgency-De.suigency factor as one of his twelve primary 
personality factors. He discusses the relationship of this factor 
to verbal fluency as follows; 


A test factor-— fluency of assocl.ition — has been in use for 
some lime as a inca.sure (Validity » 0,6S) of the cluster sur- 
gency. Now that the cluster has been resolved into two ana 
possibly three factors, it remains to be seen if the presen 
factor, as one might suspect, will cany the main correlation 
with fluency, Fluency loads: Verbal ability (very easy op- 
posites) .71, Speed of reading .5-,6, Associations in ink b o 
.S-.6. 
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The writer has iitipulilished experimenrs on tisrrr clnselv 
studied cases of cjTlical depression in which Rie.u ch.iiiu< s m 
fluency scoic accompanies- mood cliaiiftc, Kvcr.vtlnng points 
to the manic-depressive— <n, at least the deptessivc-normal, 
change being directly along this I' axis (-1). 

Ill, Fad or Analysis 

A suh-matrix of twenty test.s- tva.s selected from 'Fhur.s tone's 
battery of fifty-seven tests. Tests were selected for one or both 
of the following reasons; (a) they seemed to require the rapid 
evocation of original hypotheses and ideas and therefore were 
presumed to have a “fluency” component and (h) their fac- 
torial composition is well known and Avas used to locate and 
identify common factors such as spatial, teasoning, verbal, 
perceptual. This was done so that if any new fluency factors 
should appear they would he clearly distingubshahle from ihe.se 
older, better established factors. 

The inter-test correlations used for the analysis are thnse 
computed by Thurstonc.“ They are tetrachoric. con elation co- 
efficients based upon a sample of 218 college students, divided 
as follows: 132 Freshmen, 36 Sophomores, 30 Juniors, 12 Sen- 
iors, and 14 college graduates, d'hc modal age was 18. Scores 
were available for 113 of the subjects on the /Tyr/io/og/crt/ A.v- 
amination of the American Council on Education. 'Fhe mean 
score of the group was found to be 1.63 standard deviations 
above the national norms for 203 American colleges, indicating 
a sample with superior mental endowment. 

The correlations are positive or zero with but two excep- 
tions; between Controlled Associations and Cubes (r- — — .10) 
and between Controlled Associations and Flags (r ~ " - >1 6) . 

It was thought advisable to compute centroid factor load- 
ings based on the sub-matrix lather than to use the ccnfioid 
loadings given by Thurstonc. His loadings were computed 
from a matrix of fifty-seven tests and more factors may have 
been extracted by him than could be accounted for by the pres- 
ent battery of twenty tests. 

^ sample items of the tests see-Thurstone, L L., “Primaiy 

Mental Abilihes, Psychometric Motwgraph, I (1938), chapter IT. I'or inter-test 
correlations, see Appendix A. 
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Nine factors were extracted but only eiKht were used in 
the rotations because the loadings on the ninth factor appeared, 
upon inspection, to be insignificant, ranging only from • .15 
to —.12. Fewer factors may be c.xpectc(l to be found in this 
solution than in Thurstone’s, not only because fewer tc.st.s arc 
involved, but also because the vaiiables were selected with 
some pre-knowledge of their factorial compo.sition and purity. 

The extraction of centroid factors was made according to 
the procedure outlined by Guilford (5). 

Table 2 presents the centroid loadings, communalitics and 
reliabilities of the tests. The reliabilities are concctcd odd- 
even tetrachoric correlation coefficients. 

The centroid loadings shown in Table 2 were plotted on 
graph paper two axes at a time and rotated with the piinciples 
of simple structure and positive manifold in mind. Tht'.se prin- 
ciples call for maximizing of the number of zero or ncar-ZLU'O 
loadings and minimizing of the number of significant negative 
loadings. 

Also followed was the practice of placing axes for well-estab- 
lished factors in the positions where numerous previous analyses 
have shown them to belong. This was done on the supposition 
that if all of the factors but one in an analysis are of a well- 
established nature, they will determine the location of the new 
axis, and to that extent the location of the new axis will he more 
objectively determined. 

A new graphical method of rotation which reduces time 
and labor was employed (12). Twenty-four rotations of pairs 
of axes were necessary to satisfy the criteria of simple structure 
and positive manifold. Loadings of less than .2 were con- 
sidered as vanishing entries. Table 3 gives the final rotated 
factor loadings and the communality of each test. In no case 
did the communality of a test after rotation differ from its 
communality before rotation by more than .02. 

IV. Interpretation of the Factors 

Inspection of the rotated factorial matrix (Table 3) reveals 
that, in the main, positive manifold and simple structure have 
been attained. We may now consider the interpretation of the 
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TABLE 3 


Uml Rnliiird Factor Loading 


Trst A 


1 

Figure Clasiifii .ition . . 

-.10 

2 

CMiitrullcd Awieiatwn . 

,16 

3. 

Iiiviiuive Oppcisitrs .... 

,51 

4 

rninplt'iiiin 

.02 

5. 

Disarranged Words .... 

.42 

6. 

Fift.t .mil Last Letter .. 

.W 

7. 

AnaKraiiis 

.14 

S. 

Cubes 

,09 

9. 

Flags ■ • ■ 

.20 

10 

Form Boards 

,30 

11. 

I’urielicd tloles 

.25 

12 

Mecliariie.il Movements . 

25 

LI 

Iilciitie.d Foiiii'i 

.19 

14. 

I’ur.Miit 

-.03 

15 

Arithmetic RcasoninK . . 

42 

16, 

Verbal Analogies 

.36 

17 

[’.ittcrn Analogies 

.19 

18. 

Vocalnihtry 

.89 

19, 

Free Writing 

,15 

20. 

Word Knowledge . . ... 

77 


I ! 

C 

D 

E 

F 

G 

.49 

16 

.37 

26 

.20 

-.13 '26 

- 11 

13 

.15 

on 

.00 

,53 .53 

(10 

01 

.26 

,10 

.22 

,54 .18 

u 

.07 

.16 

.47 

17 

.52 .07 

.03 

.05 

.23 

.31 

.55 

06 .03 

,11 

.18 

.14 

- 02 

.56 

.35 31 

.11 

.07 

.20 

-.11 

.57 

• 21 ' 

.77 

.07 

.14 

.39 

,27 

.06 - 14 

.72 

.29 

,00 

.04 

.13 

- , 1 S - 01 

.50 

.62 

.24 

.24 

09 

30-06 

.34 

.63 

.33 

.20 

,05 

-.12 .14 

.11 

.45 

.50 

30 

20 

,04 - 05 

.25 

02 

.01 

.55 

- 01 

.13 12 

.74 

22 

.11 

-.05 

05 

.20 .08 

.26 

.25 

.53 

- 02 

.04 

05 - 03 

.37 

.08 

.43 

322 

.05 

27 .30 

.36 

.06 

64 

36 

.15 

,25 .07 

.04 

.03 

.00 

.00 

-.14 

.28 .32 

-.06 

-.03 

.01 

,26 

- 01 

- .04 .44 

.14 

-.05 

.40 

.21 

.26 

.13 06 


,60 

,65 

.73 

,95 

.64 

.63 

.54 

.87 

.68 

94 

76 

,66 

.43 

.66 

.59 

,67 

,79 

1.00 

.29 

.91 


rotated factor.s'. Since the correlation coefficients on which this 
analy.si.s i.s ha.seci are relatively unstable, only projections at 
least as large as ! .4 will be considered significant. 

The variables having loadings of .40 or greater on factor 
are ranked below in order of size of projection, Significant 
projections of these te.sts on other factors are also given. 


Test 

18. Vocabulary (58)-'' 

20. Word Knowledge (60) . 

4. Completion (11) ...... 

-I Inventive Opposites (10) 

5. Disarranged Words (12) 


A 

.89 

.77 

.62 

.53 

.42 


Projections 

Other 

factors 


■40E> . ^ 

47 E; 52 G 
’.54 G 
.55? 


The large number of tests having significant loadings an 
the large amount of the loadings of soine of the ^ 

identification of this factor relatively certain, The Voca u 
Test which has approximately 79 per cent of its 
counted for on this factor, is a fairly difficult vocabu ary 


®Thc number in parentheses following the 
Thurstnne’s Primary Mental Abililm Battery. 


teat name is the variable nun>ber in 
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of the multiple-choice type. The ironZ-A'iiox'/rc/gr Tret is a 
similar test at a somewhat lower level of clilHculry. Ir ha.s ap- 
proximately 60 per cent of Its vaiiance accounted for by this 
factor. The other tests haviitR significant loading.s on this fac- 
tor also seem to have a knowleclRO of the mrdnivt^ nf tvords as 
an important part of the task, whereas none of the tests with 
vanishing loadings seems to require this knowledge. The fac- 
tor can therefore be identified with reasonable confidence, as 
the verbal factor which has been identified previously*' in a 
number of studies. 

Factor B has the following tcst.s: 

Tests 

8. Cubes (18) 

14. Pursuit (27) 

9 Flags (20) 

10. Form Boards (21) 

1. Figure Classification (8) 

None of the tests with loadings of .4 or higher have verbal con- 
tent. The tests with the highest loadings' .seem to involve the 
ability to see spatial relationships in two or tliree dimen.sions. 
This function seems to be absent from all te.st.s with negligible 
loadings This factor can be identified with the .spati'al-rclation.s 
factor found in numerous previous analyse.s'. 

The tests with significant loadings on factor C are: 


„ Other 

^ Factors 

11. Punched Holes (24) 63 .... 

10, Form Boards (21) .62 .SOB 

12. Mechanical Movements (25) ... .45 .50 D 


The common function heic seems to he the ability to visual- 
ize. Evidently Thurstonc had both the spatial and the vi.suali- 
zation variances of his tests appear together on the same factor. 
A clue to the difference between these functions may be ob- 
tained by examining the tasks involved in Cubes, wdiich ha.s 
high spatial saturation and no visualization saturation, and in 
Form Boards, which has high loadings on both factors. In 


B 

Other 

Far tors 

.77 

.39 K 

,74 

t k t t 

.72 

« » » 1 

.50 

.62 C 
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the Cubes 7 est the siiUjeet is asked to iccognize whether the 
parts on the sidi-s of the ciihe patterns hold the same iclation- 
ship to eadi other aftiT the onhe has been rotated. Both origi- 
nal and final positions are shown and need not be visualized. 
In the Form Ihutrih Test, however, not only must the parts 
given he visualized iti a new, rotated rehiticmship, but the 
final positions of the paits within the form must likewise be 
vivSU a I r/.ed. 



The common function that the tesi.s high tm this factor seem 
to share is reasoning ability. It is not clear, huwcvei, why one 
vocalmlaty test sluuild ha\'e a .significant loading on thi.s factor 
and the othei none at all. 



It i,s customary to identify the factor on which the loading of 
identical forms or similar tests appears lehitively pure as a 
speed-of-pereeptton f*actt>r. It is interpreted as the ability to 
perceive (juicklv details imhcdtletl in irrelevant material. It is 
not dear, however, why a test which is wholly verbal in con- 
tent, like (’otu])letiou, should have a significant projection, 
whereas other tests, nune ulivimi.sly visual, do not. It may be 
that, due to the low difficulty of the items of the Completion 
Test, speed of reading was a .significant factoi in determining 
final .scoitss. 
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Factor F has the follovvinR tests: 


Test s /•’ 

7. Anagrams .^7 

6 Flist ami Last Letter SJ) 

5. Di.sarrangecl Woni.s .''5 


ChJirr 

Fat'inrs 


42 A 


Thurstone’s description of the functinn urukTlyiiiR this factor 
as a fluency in dealing with vvord.s* .separate from their idea.s and 
meanings, still seems satisfactory (fl). The uh.sencc* from this 
factor of other verbal and non-verbal tesst.s which pre.sTimahly 
have an element of fluency indicates word fluency to he a 
restricted type of fluency. 


Factor G has the following tests; 



Tests 

(r 

Other 

Fartws 

3. Inventive Oppositc.s (10) ....... 

.54 

,.5.^ A 

2. Controlled Associations (9) 

.53 

..S.3 11 

4. Completion (11) 

52 

.62 A; 47 K 


This factor is restricted to the three tests whicli were selected 
to represent “speed of calling up pertinent as.sociation.s.” It 
can probably be identified with Carroll’s speed-of-word-associ- 
ation factor and Thornton’s mental-fluency factor (3,7). Here, 
as in factor F, significant loadings for non-verbal tests are con- 
spicuous by their absence and the function represented seems 
to be restricted to verbal tasks. 


Only two tests have significant loadings on factor H, 


Tests U 

2. Controlled Associations (9) .53 

19. Free Writing (59) 44 


Other 
Factors 
.53 0 


Since this factor is what is commonly referred to as a “doublet,” 
i.e., only two tests on it have significant loadings, it is not pos- 
sible to tell whether some function specific to these two tests or 
a broader function is represented. In the latter case some in- 
teresting possibilities present themselves. One is that it is a 
speed of writing” factor. Another possibility is that the com- 
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mon function is “verbosity,” the speed of producing a large 
number of words in a limited period of time. In either case, it 
would seem to be related to Johnson and Reynold’s “free-flow- 
of responses” factor and Carroll’s “spced-of-production-of- 
ineaningful-cliscouKsc” factor (3, 6). 

V. Discussion 

In addition to a word-fluency factor, Thurstone’s data 
yielded two other factors which resemble factors previously 
identified as fluency factors. One of these is interpreted as a 
speed-of-association factor. It resembles Thornton’s verbal- 
fluency factor, Carroll’s spccd-of-a.s.sociation factor, and John- 
son and Reynold’s flow factor (3, 6, 7). The crucial function 
involved vseern.s to be the ability to associate rapidly a large 
number of words bearing a given relationship to a stimulus 
woid. 

J'he other candidate for interpretation as a fluency fac- 
tor is a doublet and it cannot, therefore, be identified in the 
present solution. It docs, however, bear a resemblance to 
Cairoll’s “Rate-of-production-of-meaningful-and-syntactically- 
coherent-discourse” factor (3). The number of words written 
in a theme seems to be a relatively pure measure of it. If this 
factor can be verified, it probably comes close to what is usually 
meant by fluency of organized verbal discourse. 

There is no indication in the results that fluency is a general- 
ized function appearing in several media. There is, in fact, very 
little oveilapping of any function in verbal and non-verbal tests. 
The reasoning factor is the only exception, three verbal and 
two non-verbal tests having significant projections on it. 

The following are the conclusions from this study; 

1. There are two, possibly three, independent types of 
verbal fluency. 

a) Fluency in dealing with single words. 

b) Fluency of association for common words where there 
is some restriction placed upon the response. 

c) Rate of production of syntactically coherent discourse. 

2. Vocabulary tests in Thurstone’s Primary Mental Abili- 
ties Battery are more heavily saturated with verbal content 
than he had found. 



46 EDCCA'noNAl. AND I’sYClinl Ml AsVHS M5 N r 


3. It is p<tshihli‘ to hiinn out sqiatatc sp.itiai-u'iuiions and 
visuulizutkm factors from 'rhutstotic’s dafa^ tcplarmp; Ins one 
spatial factor. 

4 Verbal and non-verbal tests U ml to be piojVctcd on sepa- 
rate factors, the reasoning factor appr .uiau to br .m exception. 

5. No evidence of a utuvctsal thuncy lactor. ccimnum to 
verbal and non-verbal tests, vs as foumi, 

Sinmiuiry 

In view of the followinft con,sidei.ttiuns, it was believed that 
an analysis of a sub-bacicry rtf 'riiurstone's Prbiutry Mental 
Abilities Tests might yield further informathui concerning the 
nature of fluency; 

(1) One of the factors identified by 'riuirstont' was a wrtrd- 
flucncy factor. 

(2) Thurstone’s solution included .some unidentified factors. 

(3) The Primary lifciital Abilities liatiiry contains tests 
similar to .some that weie found to define fluency fac- 
tors in other analyses. 

(4) Kvidence from .suhserprent analy.se.s indicated that vo- 
cabulary tests sbould have higher verbal loadings than 
they do in Thunstone'.s .solution and that .separate 
visualization and spatial factors should replace Thur- 
stonc’s spatial factor, 

(5) Not all of Thurstone’s axes hail been rotated to posi- 
tions of simple structure and positive niunifohh ii’di" 
eating that another solution might he found which 
could shed more light on the nature of fluency as well 
as resolve the problems mentioned above, 

A sub-battery of twenty tests was selected from I'hurstone’s 
Primary Mental Abilities Battery. Might centroid factors were 
extracted and rotated, two at a time, by a new rotational tech- 
nique, to psychologically meaningful po.sitiori.s‘. 

Six of the factors were identified with rca.sonahle confidence. 
They are verbal, spatial-relations, vi.sualization, reasoning, per- 
ceptual, and word-fluency. Two factors are less well iclentifieci. 
One has been interpreted as a "speecl-of-a.ssociation” factor. 
The last factor is a doublet and cannot be interpreted but seems 
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to bear a lescmblancc tci a previously identified veibal-fluency 
factor. 

The major conehLsiun.s from this study are; 

' 1. Two, possilily thu-e. types of verbal fluency can be 
identified. 

2. A universal fliieru'y factor, common to both verbal and 
non-verbal tests, did not appear, 

3. Separate .spatial and vi.suali/.aiion factois can be brought 
out from Thurstone’s data. 

4. The vncahiilaty tcasts are more heavily .saturated with 
veibal content than Thinstone had found. 
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PRACTICAL SUC3GESTI0NS FOR IMPROVING 
T1-:STING PROCEDURES 


LEO CHALFEN 
New York University 

I. huroduction 

The concern of this paper is the development of an approach 
to a testing procedure which is applicable in most situations. 
Unfortunately, much desirable information is not leadily ac- 
cessible in the present state of orientation of testers and the 
present stage of development of psychological instruments. 
For the psycho-clinician this lack presents a threefold challenge 
to action : an advancement of research to aid in the construction 
of better diagnostic and prognostic instruments; a better inte- 
gration of theory and practice; and a more thorough utilization 
of the knowledge and techniques which are available, The 
primaiy concern of this paper is with this last putpose. 

A more fruitful use of present instruments is hampered by 
an ignorance of available procedures, by a lack of creative 
imagination, and by certa^ln artificial limitations which are 
self-imposed. The concept of what is implied in the scientific 
method must he clarified. A more extensive use of the clinical 
criteria of representativeness, optimity, and appropriateness 
(see section II) is suggested both in obtaining and in assessing 
test results. The construction and use of test batteries and 
test sequence.s must be justified psychologically as well as sta- 
tistically. 

n. Implications of the Scientific Method 

Unfortunately, many testers formulate hypotheses as to the 
status of the testee in a routine fashion on the assumption that 
there is a one-to-one correspondence between the behavior of 
the subject and the ability which theoretically underlies the be- 
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havior. This approach lacks scientific rigor. 'I'lie tester should 
avoid making an assumption on this point. HLs hypothesis 
should be subjected to inquiry and expetimeiuation without 
restriction, keeping in mind the fact that tlie test is an analysis 
of behavior at a certain moment and under certain conditions. 
At times the results aie unexpected, but alway.s accepted and 
systematized by the competent examiner. It should he stressed 
that hypotheses precede stati.stical manipulation and standaid- 
ization. Spearman (7), after Udney Yule, saj's that the main 
function of statistics is to aid in testing conclusions alieady 
reached by other means. This point is vital to the apprecia- 
tion of a method of testing which does not adhere rigidly to a 
fixed procedure m test administiation. 

Beck (1), Wells (9), and Hoist ct al. (2) refute the implica- 
tion that a test item has the same meaning for every subject. 
Differences in interpretation of items may he mis'conslrucd as 
actual differences in the subjects. It is, therefore, tlie ta.sk of 
the examiner to present to the subject “. . , the test prolilcms in 
those proportions which are closest to those by which the norm 
was established” (9). For example, the use of the JV arrest of~ 
Wells Memory Test in a state othei than Massachusetts would 
necessitate the substitution of local cities for tho.se given in the 
test, and even then there would be no assurance of compara- 
bility. 

Variables can be under some measure of control in testing 
so that one knows readily the relationship of stimulus and re- 
sponse. Assuming that the test is valid, that an intelligence 
test actually measures intelligence, or that a test of manual dex- 
terity measures speed and accuracy of movement, the examiner 
is not free to introduce extraneous factors into the testing situa- 
tion (and interpretation), such as persistence, anxiety, reading 
proficiency, or the ability to understand unintelligible instruc- 
tions. The expert examiner controls a testing .situation, at 
times rephrasing instructions or .shifting the order of task.s with- 
in a test (as allowed on the Merrill-Palmer and the Wechsler- 
Bellevue scales (9, pp. 171-172) ), so that the subject is aware 
of what is desired and is cooperating actively. Without such 
cooperation the subject may intrude Intentional or uninten- 
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tiorial (IccH-ptKtn on .sclf-udniinistcrec] personality and interest 
inventories as found by .Steimnetz when using the Strong Voca- 
tinmtl hurrest Blank, 

The observations of many testers have resulted in their 
siiessing the ileletenous effect on test performance of attitudes 
such as recaleii rancy, lack of self-confidence and nervous ex- 
citement. .Several studies (3, 4, b) have shown that psycho- 
metric results in the intellectual and psychomotor areas are 
affected by the attitude of the subject. 

Probleni.s aiis'c which cannot be handled unless the best use 
is made of the avadable armamentarium of the testei. In illus- 
tration, note the problems of measuring the abstract ability of 
a subject with organic brain damage, the educational interest 
pattern of an adolescent girl, or the manual aptitude of a blind 
person. I’lie first case might he handled by administering the 
Rorschach or the Ilanfmann-Kasanin version of the Vigotsky 
Test, even though neither of these has as yet been adequately 
validated. The adole.scent giil might he given the Garretson- 
Symoruls Interest Questionnaire even though this was standard- 
ized only on high-school hoys. I'he blind person’s manual 
dexterity could be measured by some of the existing tests which 
do not depend primarily on vision, after enough practice trials 
arc provided to give, spatial orientation. The material so ob- 
tained can be of real aid if it Is interpreted with full awareness 
of the limitations of the method. 


in. Suggestions from Clinical Criteria 
The meaning and usefulness of the results can be judged 
against the criteria of representativeness, optimity (4) and ap- 
propriateness. Representative results aie elicited when the sub- 
ject is cooperative (exhibits self-confidence, interest and effort). 
If tlifsc es.sentials arc not present in an adequate amount there 
can he no as.surance that the test results are indicative of the 
suhjeetTs' true nature and of the level of behavior — as far as the 
tests can measure. Roc and Shakow (4) list other conditions 
outside the voluntary control of the subject and usually of a 
temporary .■Ag/.Pt tlie-.aap.rj^jiantari.vaDP-^ test 

results, such as ysical 


iiBuA Y k 
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Illness (headache), physical disability (loss hcaniiR aid), 
emotional upheaval, or some types of psychotic episodes ( manic 
hallucinations). Hoist et al. (2) say . . pcifoirn.iiu'e in an 
activity can not be viewed as an isolated phennnsenon outside 
the environmental context in which the activity takes place.” 
It seem.s clear, therefore, that express'inp results in any such 
terms as IQ or wpm, (in a typing test) is meaningless when they 
are not repiescntative for cither of the aforementioned internal 
or external reasons. However, in keeping with the thesis, they 
can be presented descriptively even though they ate unrepre- 
sentative, granted that they are used as diagnostic elements. 

Roe and Shakow (4) also mention the concept "optimity.” 
Results are optimal only if they are repiescntative, if the .sub- 
ject has no language or permanent phy.sical handicap (blind- 
ness), is under forty years, and if the examiner considers the 
results indicative of the highes't level the subject has ever at- 
tained. It seems sounder psychologically to limit this con- 
struct of optimity to measures of capacity (and to broaden the 
base of such a judgment to mclude the highest level of attain- 
ment predictable for the future). Optimity i.s judged pairially 
by psychometric signs like consistency between scores of tests 
of the same dimensions, consistency of inira.suhtesr and inter- 
suhtest scores, and comparison of the rcsult.s of repeated re.sts 
of the same function. It is judged partially against biographic 
criteria like occupational level and the nature of responsibilities 
ever held, the age of attaining the level of highest education, 
and the social and civic status throughout the yeans. 

The third clinical criterion is that of the appropriateness of a 
test. To satisfy this criteiion the examiner justifies the pur- 
pose for testing. The variables to be considered in choosing the 
right instruments for the task are dependent upon the nature 
of the problem and the availability of sound testa. For ex- 
ample, in measuring the intellectual level of a normal adult 
the Wechsler-Bellevue is generally preferable to the Stanford- 
Binet even though the latter is a valid measure of intelligence, 
namely, because the standardizing population of the former in- 
cludes adults. Yet for an uncooperative adult mental patient 
the Goodenough Drazo-A-Man Test, developed for use with 
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children, may he profitably administered. In various situa- 
tions different varialiles have lelative importance in deteimin- 
ing the choice of test; these are the testee’s age, sex, educational 
and cultiual haclcground, and the type of infoimation desired. 

IV. Selection and Use of Test Batteries and Sequences 

A procedXire about which little is known or done is the con- 
struction of test hatteric.s and sequences. A test battery is 
a senes of tests which is dependent upon many factors for its 
content, extensity, intensity, diiection and sequence. A ration- 
ale coveting these points may be established upon principles of 
testing, efficiency and feasibility. The actual content of the 
test material is determined by the original testing problem and 
its development as the session progresses. The compilation 
and collation of the various measures used for individual test 
batteries is dependent first on their reliability, validity and ap- 
propriateness. 

The number of tests used gives little indication of the ex- 
tensity of measurement. Seiclenfeld (S ) deplores the “shotgun 
test proceduie” by which the subject is exposed to innumer- 
able te.sts in the hope that some worthwhile Information will 
be gained. Professional competence and sound clinical judg- 
ment is invaluable in the choice of a functionally optimal num- 
ber of measures in the battery adequate for the task. The 
psychological effect of being bombarded with an excessive num- 
ber of te.sts is not definitely known, but it is quite unlikely to 
be conducive to feelings of confidence and interest and effort. 
Intensity of measurement can sometimes be subjected to the 
criticism of unnecessarily duplicating measures plus that of 
ovenstepping the bounds set by the testing problem, the policy 
of the iuvStitution or the capability of the examiner. ^ 

The matters of sequence and direction are relatively un- 
known factors. What is the effect on the subject and on his 
results of any one test following another? Since experimental 
data does not define this area, it is suggested' that greater 
reliance be placed on the clinical judgment of the examiner. 
Results which are more likely to be representative and optima 
as well as reliable and valid may be obtained by satisfying the 
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ciiteria of section III This means plannuii; a st cnifna* so that 
the subject does not become boied or futiftuerl or uiululy anx- 
ious during tests not piimarily intended tt» measure anxiety, 
or uncooirerative because of apprehension or lack of rapprut. 
To avoid these pitfalls — as far as the tests :ue concniunl- the 
sequence could well be planned on an individual basis in an 
attempt to comply with the purpose for the testing and to adapt 
the means to the subject. Quite probably tin* Itest pioceduic 
will be one which begins with a measure whioli is meaningful 
(in relation to his problem) to the subject. The use of some: 
brief obvious test of ability like a spelling test for clerical 
workers or a rate of manual manipulation test for packcis and 
shippers often solves this pioblem. In the early part of the 
battery the subject is less likely to react unfavorably to those 
tests which may tax his patience or endurance. If many nieas-- 
ures requiring concentrated effort aic to he given, intersper.sal 
between tests which are untimed or which differ in the funcrinii 
measuied may attenuate the fatigue. For example, if two 
tests of mental ability are used, they shoultl not follow one 
another any more than two mca.s'ures of finger dexterity. In 
using personality tests it seems better to piecede the fairly 
obvious inventories with the neutral or ambiguou.s content pio- 
jective techniques. If procedures which have charged content 
or which present stress situations are left for the latter parr of 
the testing session or for another period, tliere tvoultl he hes's 
information lost in case of any reason for di.scon tinning the 
testing. 


Ihe administration of a series of tests is further complicated 
by planning the direction of the series to measure those a.spects 
of the psychological dimensions (intelligence, interest, per.sonal 
and social adjustment, capacity, proficiency) which are per- 
tinent to the testing problem as it develop.s.^ In illu.st ration, 
to help plaii a practical vocational goal, the early definition of 
pertinent dimensions (intelligence and vocational interest) is 
desirable. From the results obtained probing need be done 
only in those areas inhere planning is feasible (this approach 


planning is seen in the program of the Test 
r^rSef Community Advisory Serv- 
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meets the ohligritions of the criterion of efficiency of testing 
inheicnt m SeicJcnfelcI’s ruticle (5) ). An individual of bor- 
derline intelligence cannot plan on a professional careei, nor 
will a subject whose measuretl inteiests aic in literary and per- 
suasive puisuits be most satisfied in manual activity. In a 
diagnostic pioblem the same piocedure holds, early definition of 
pertinent cliinensions to aid in the constniction of an efficient, 
feasible test battery (such as, intelligence and visual ability in 
a reading difficulty; personality stiucture and dynamic content 
in a diffeienii.il diagnosis between a reactive depiession and a 
mamc-depie.s’sive depre.ssion) . 

Fiequently the couise of the testing changes as new infor- 
mation apiieais. h'or example, the original pioblcm may be 
the advisabilit 3 '' of the subject’s consideiing engineeiing as a 
career. 'I'his' plan 01 : 13 ' be ruled out immediately if his intel- 
lectual level is too low, at which point the testing may be 
oriented towaid lelated occupations recpiiring a lowci level of 
intelligence. If his measured interests were in social welfare 
and hi.s evaluative attitudes high in the social and religious 
spheres the direction of the te.s-ting could he changed accord- 
ingly. If an instilutionali/ed patient were being tested, and 
his intelligence test results suggested biain damage, specific 
study of this proldem would certainl 3 '^ follow. Direction and 
sequence cannot be planned scpaiately according to the pre- 
ceding discussion. 

V. Summary 

In an attempt to obtain meaningful and useful information 
from tests it is suggested that current tools be utilized to their 
fullest extent by p.sycho-clinicians. Test information may be 
more useful when elicited and evaluated against the clinical 
criteria of representativeness, opiimity, and appropriateness. 
Test battery and test .sequence administration may be profit- 
ably based on clinical judgment, at least until experimental 
data define ihi.s area. 
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COllNSKI.INCJ STUDKNTS TOWARD SCHOLASTIC 
ADJUSTMENT 

Sl'ANLEY A STROMSWOLD 
C. (JILBERTWRENN 
University of Minnetota 

A FIRST consideration in discussing scholastic adjust- 
ment is a ngorous definition of the term. In this paper, 
schrtla.stic adjustment will he defined in terms of the character- 
istics exhibited by a well-adjusted student, rather than in terms 
of s'cholastic grades alone. It will be necessary, therefore, to 
consider the charactcristic.s' of those students who are making 
satisfactory progres.s in the direction of attaining major educa- 
tional objective.s. 

I'he idea of scholastic adjustment may be enlarged by 
suggesting that the well-adjusted student possesses the six 
characteristics li.s'ted below.* Einst, he has a high degree of 
intrinsic interest in the subject matter he is studying. Second, - 
he has a positive attitude toward the more detailed require- 
ments of his particular curriculum. This means a frame of 
mind which will result in a wholehearted acceptance of the 
challenge of these requirements. Third, he accepts a realistic 
evaluation of his own aptitudes and personality. Fourth, he 
ha,s the ability to concentrate for a reasonable length of time 
on day-to-day ta.sks. Fifth, he exhibits stability in his goals 
and in hi.s emotional life. Sixth, he is able to enjoy life in 
many area.s, 

Thi.s concept of scholastic adjustment is perhaps not as 
iinivcr.s'ally accepted and practiced as the concept expressed 
in terms of scholastic grades. The passing-grade idea of ad- 
justment implies achievement at a specified level in one area, 

’■Tliis idea of adjustment draws upon the psychological concept of the well- 
adjusted person. For a fuller discussion of normal adjustment, see item 9 in the 
References. 
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usually a narrow subject-matter area, as the criterion of ad- 
justment. While this has some merit in profes.sional education 
by protecting society from incompetent practitioners, it does 
not constitute a broad enough basis for the counseling of stu- 
dents in general. There aic many students whose sulijcct- 
matter achievement is safely above the threshold of a C aver- 
age but who are poorly adjusted. These students represent 
an exceptionally good oppoitunity for the counselor to pro- 
mote a fuller development of the nation’s human resources. 
Our concept of scholastic adjustment implies that every stu- 
dent should be brought to accept the rcspon.sibihty for attain- 
ing his optimum proficiency in various areas of living. A 
democracy needs the maximum development of its ablest as 
well as of its average citizens. 

II. 

The foregoing concept of scholastic adjustment implies that 
the counselor or adviser must view the scholastic problem in 
the context of the personality of the client in diagnosing and 
in developing theiapeutic measures. For tlierapy to he suc- 
cessful in modifying behavior, that is, to promote better ad- 
justment, it will be necessary for the clinician to view the 
client longitudinally as well as to deal with the immediate 
symptoms that he presents. This will enable the counselor to 
comprehend the manner in which the symptoms developed. 
The etiology of the symptom to a large degree will suggc.st the 
depth and extent of the psychotherapy necessary. This, of 
course, will also be influenced by the unique pattern of each in- 
dividual case. In general, one might expect problems of moti- 
vation or the incongruency of ability and objectives to require 
deeper therapy than the mere lack of study skills and habits. 
The latter is largely a matter of teaching, while the former is a 
matter of the reorganization of the student’s attitudes toward 
himself, or it may be the release of tensions resulting from 
conflict. The outcome of such reorganization or release will 
be more effective behavior and a better-adjusted person. 

The clinical interview in which objective measurements 
play a part is an effective procedure in diagnosis as well as in 
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therapy. In the counseling intei-view, the clinician will have 
to seek out the primary cause.s of maladjustment while at- 
tempting to deal with the immediate attitudes and needs of 
the client. Often it will he neces.saiy to deal with the im- 
mediate secondary .symptoms hefoie the primary causes may 
be uncovered For example, students frequently present dis- 
placed emotional reactions such as antagonism toward piofes- 
sors, for v'hich some release can he found through a permissive 
situation with fiee expre.ssion of these emotions, Free expres- 
sion may lead to an awareness of the responsibility of the in- 
dividual in the situation and to a more realistic approach to the 
solution of the client’s pioblems. 

The next thing to he con.sddered is the attitude which the 
client takes tow.ird his problems. Heie, we frequently find 
such tendencies as withdrawal with negativism, indiffeience 
toward the environment, compensation in other activities, 
rationalization, and dependency. Whatever the attitude pre- 
sented, the counselor should have as his goal the freeing of the 
client fiom aLtitude.s whlcli prevent him from accepting a 
realistic evaluation of his problems. 'Fhis will make it possible 
for him to make a more direct attack upon immediate problems 
and needed skills. 


III. 

As a guide for the counselor it is well to set up several diag- 
nostic constructs or possible hypotheses of need (2). The 
five constructs herein listed will include the majority of the 
cases presented on the average college campus. 

1. The first diagnostic construct is misclassification. Stu- 
dents included in this category do not have the aptitudes, in- 
terests, and other personality factors demanded by the particu- 
lar curriculum which they arc pursuing. Since the student 
does not have the personal resources demanded by hi.s environ- 
ment he is precipitated into a persistently non-adjustlve state. 
The symptoms presented by the client, which should result 
in the diagnosis of misclassification, are fairly evident to the 
counselor. The client, on the other hand, is usually not aware 
of the meaning of these symptoms. These symptoms include 
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aptitude scores which show a small piohahility of success, 
failure to meet prescribed standards in spite of strong motiva- 
tion and cfFoit, considerable anxiety, rationali/.ation, and pro- 
jection. Most of the difficulty in this type of student arises 
from his resistance against acceptance of the inappropriate 
nature of his goals in relation to his aptitudes. A freipiont 
reason for his refusal to accept reality is that it lepresents to 
him an attack upon his ego and a threat to his social accept- 
ability. The therapy in thi.s type of situation consists largely 
in getting the client to sec that he can achieve personal satis- 
faction and social acceptability by puisiiing other goals. This 
will free the client from the need of defense mechani.sms and 
will enable him to make a realistic appraisal of himself and his 
projected program. 

2. The second diagnostic con.siruct is inadequate educa- 
tional background. The important symptom here is that of 
academic work being performed at a level considerably below 
the client’s potentialities. This type of client makes up a con- 
siderable percentage of that group of students usually referred 
to as underachievers. Inadequate educational backgiound 
may be present in only one or several areas. I'his problem is 
often met in dealing with the more technical curricula. I’or 
example, students admitted to third- or fourth-quarter French 
on the basis of high-school work sometimes find that their 
high-school work was of such poor quality that they are not 
prepared to pursue the more advanced work. Or a .student 
may find it almost impossible to follow hl.s physics course be- 
cause he is unable to manipulate even the simplest elementary 
algebra. The therapy for these clients is obviously, by one 
means or another, that of providing the opportunity to learn 
the prerequisite information and skills. Many campuses now 
provide courses in sub-freshman mathematics, suh-fre.shman 
English, and other fields to meet these important educational 
needs. 

3. The third diagnostic construct is inadequate command 
of study habits and study skills. This group, like the second, 
contributes a considerable percentage of the underachievers. 
Here, however, the deficiency is not so much in a specific sub- 
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ject-mattcr area as in iiiaclcquate methods of attacking learn- 
ing problems. Bc.sules the usual reading and wiiting skills 
which are often found deficient, \vc find that college work de- 
mands the foimation of a number of new skills, such as taking 
lecture notes, the use of the library or wide reading on a topic, 
and efficient techniques for memorization. Here, the therapy 
is a matter of stimulating the client to learn the skills and to 
form the habits necessary to meet the challenge of college work, 
This can he clone by providing reading clinics, how-to-study 
courses, and by counseling. Not only can the counseling in- 
terview be used as a means for .selecting those students who are 
most apt to profit from these experiences but it also can be used 
as a means of bringing about learning readiness. Counseling 
should lead the client into a realization of the necessity for ac- 
quiring more effective study hal)it.s and skills Where such 
C0U1SC.S and clinics are not available, or when the counselor 
considers it more prudent, the interview may be used as a 
means for pointing out to the client mine efficient techniques 
of study. When this method i.s used, follow-up inteiwiews aie 
very desirable. Effort must he made to see that the learning 
become.s functional. At these follow-up interviews, the coun- 
selor should discuss with the client how well these new pro- 
cedurc.s arc working out in his individual case. At this time 
modifications to fit the individual needs of the client should be 
made.“ 

4. The fourth diagno.stic construct is inadequate use of 
time. (Inadequate use of time may be a symptom of some 
other disorder as well as a separate diagnostic construct.) 
This is also responsible for many cases of underachievement. 
Here, we are confronted with the necessity of leading the client 
to change his habits. I’o a certain extent, we should stiniulate 
the student to routinize his daily life to make room for his 
work and his play. As a preparation for doing this, the stu- 
dent should analyze the nature of the distractions which keep 
him from working during the time he sets aside for that pur- 
pose. 

^ The uic of smtly manusils is also often effective for these clients. Items 3 
8, 11, and 12 in the References arc excellent examples of concise and practical 
manuals for that purpose. 
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In most cases, some type of time ImdRet will be desirable. 
A student should be encouiaficd to schedule .study periods as 
he schedules hi.s lectures and laboratory work. An interesting 
obscivation may be made at this point, in .setting up time 
budgetii — students are apt to set up :i budget which is not 
workable because it i.s too ambitious. A good way to avoid 
this is to suggest that a student begin by planning his work only 
a day at a time. Students should be encouraged to make out 
a schedule of the next day’s activities in the evening. After 
having done this for a week or more, tlie student may gradually 
learn how much time must be spent on each lesson and how he 
can best fit his work peiiods into his daily life. After following 
this procedure for one or two week.s, the client can build upon 
these experiences to set up a time schedule for a week’s work. 
To facilitate habit-formation, it is well for him to attempt to 
study the same thing at the same time daily. A time schedule 
built up in this manner has the advantage of meeting individ- 
ual needs much better than one which is set up according to 
the ideal schedule for that mythical entity, the average person, 
5. A fifth diagnostic construct is inteiference with study 
by problems outside of the scholastic realm. 'Fhe student who 
is constantly in emotional turmoil because of such common 
problems as conflict with parents, inability to make pioper 
social adjustments, or financial problems, cannot be expected 
to do his best. It is now recognized that in compensating for 
such problems, students may become scholastic ovcrachiev- 
ers. In harmony with the idea of scholastic adju.stment pre- 
sented m this paper, these students are not, however, the 
“good” students. In this situation, the counselor, through 
a permissive atmosphere, should encourage the client to discuss 
his problems and provide the means for self-acceptance and 
self-resolution of conflict. Study habits, time .scheduling, and 
reading clinics arc apt to prove of little value in .such cases, 
No counselor can affoid to restrict his counseling to study 
problems. Each client presents a unique pattern of character- 
istics and must be dealt with accoiding to his own felt needs. 

Careful attention to the adjustment problems of students 
is one of the most promising means of increasing the value of 
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education to society. Not only should it serve to decrease 
the number ol maladjusted and disgruntled students who fail 
scholastically but it should also perform the more important 
function of stimulating the able student to perform on a level 
commensurate with his ability rather than to slide through 
witli a minimum of effort. The loss to society through educa- 
tional underachievemcnt on the part of capable students is very 
great. It is axiomatic that a democracy can not rise above the 
level of its citizenry. 'J'he counselor who stimulates these 
capable individuals to a fuller utilization of their abilities is 
performing a significant social service. 
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A PROCEDURE FOR OVERPRINTING ANSWER 
SHEETS FOR HAND SCORING WHICH 
MIGHT BE ADAPTED TO LOCAL 
SCORING 

ARTHUR E TRAXLER 
Educational Records Bureau 

In connection with the spring testing piograms of 1946 and 
1947 carried on by member schools of the Educational Records 
Bureau, the responses to the Cooperahve English Test were 
recorded by the pupils on separate answer sheets regardless of 
whether the tests were to be hand scored or machine scored. 
For all tests which were to be hand scored, the scoring key was 
overprinted on the answei sheets before the scoring process was 
begun. Ciicles connected by short, straight lines were printed 
around the right answers. The scoring procedure consisted of 
counting the number of responses which fell within the circles, 
then counting the number outside the circles, and finally of 
subtracting from the correct responses a proportion of the 
wrong responses. On the complete English test, including 
Tests A, B, and C, the scoring time saved by this procedure, 
in comparison with the time required for scoring when the 
answers were written in the booklets, was 6.4 minutes per 
paper, or approximately 42 per cent. 

The overprinting not only sAved a significant amount of 
scoring time, but it also facilitated the use of the test results. 
When sepal ate answer sheets are scored in the usual way, either 
by hand or machine, one limitation is that no indication is 
made on the paper of which questions were answered correctly. 
Thus, it is difficult for the pupil, teacher, or counselor to study 
the paper and to determine the questions on which the pupil 
did well and those on which his performance was poor. The 
overprinting makes an analysis of this kind comparatively 
easy, provided, of course, that a booklet containing the ques- 
tions is available, 


(16 



66 EDUCATIONAL AND rSYClU)I.l)t,lCAL NILAhURI MLN 1' 


The diagnostic and ictearhing advaniagt's of nvci printing 
were thought to he hufhcieinly large to warnuit the over- 
printing of answer sheets sctued hy machine, as well as those 
scheduled for hand scoring. In the case of the maehine-seoied 
answer sheets, however, the overprinting was dtme after the 
scoring was completed. 

The overprinting was done on a multilith, mimher 12S0. 
In order to insure that u siifHcieiir numher of copies could be 
made without the necessity of preparing new plate.s periodi- 
cally, the various answer keys were pltotogiaphed on nniltex 
plates. During the overprinting, the answer sheets could 
be run through the multilith at a speed of about .i.lH'K) copies 
an hour. However, great care in opeiatitm wa.s im])eratlvc 
in order to obtain as neaily perfect registration u.s possible 
and to guard against the danger of the answer sheets liecciming 
jammed in the machine and damaged or destroyed. 

This experiment suggests .some interesting possibilities for 
the use of ovcrpilnting in the local scoring of ohjeetive tests. 
To an increasing extent, test puhlishers are furnishing answer 
sheets with their tests, and, in the case of a eonsiderahle 
number of new tests, the use of answer sheets is being made a 
requiiemcnt, since theic is no provision for writing the an.swcrs 
in the booklets. Yet, many public schoohs — t‘Ven some of the 
larger school systems — arc not yet ecpiipped with scoring 
machines. The hand scoring of the anstver .sheeW i.v either a 
long and tedious clerical job for teacheis or counselons or the 
school has to provide a sizable budget for clerical .scoring help. 
It would seem that the overprinting proccdiue might .save 
public schools hundreds of hours and thousands of dollar.s. 

Even where the scoiing is now provided for on an adequate 
basis either by machine or hand methods, overprinting might 
be worth the cost through improving teacher, coun.selor, and 
pupil use of the results. 

There are, however, certain technical probIem.s in the adap- 
tation of the overprinting procedure to local use. Compara- 
tively few schools are equipped with multilith-s. Most schools 
do have mimeograph machines, but the registiation with the 
mimeograph is not as accurate as it is with the multilith. The 
mimeograph is often beset with paper-feed troubles with the 
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resultant crumpling and teaiing of several pages before the 
machine can be slopped. Moreover, the IBM answer sheets 
for certain tests are too wide to be fed through a standard 
mimeograph. 

On the otlier hand, there is some evidence that overprinting 
with the mimeograph is feasible. Some years ago Stenquist^ 
reported that the labor of .scoring was reduced through the use 
of the mimeograph in overprinting answer sheets for tests grven 
in the Baltimore Public Schools. An experiment run with 
the mimeograph at the Educational Records Bureau indicated 
that the registration was sufficiently accurate on about 99 per 
cent of the answer sheets. 

If there were sufficient demand for the adaptation of answer 
sheets to the requirements of overprinting, perhaps test pub- 
li.shers could use care to sec that special answer sheets prepared 
for use with their tests were of a width such that a standard 
mimeograph would take them. Another way in which test 
publishers might aid schools with this type of scoring would be 
to furnish their answer keys on stencils ready for use in over- 
printing. 

A question might be raised concerning the possibility that 
an organization such as the Educational Records Bureau 
could at a very low charge set up an overprinting service for 
public schools that desired to receive that type of aid with their 
scoring and to handle the rest of the scoring procedure locally. 
The addition of this kind of service to the Bureau’s present 
services would not be possible during the fall and spring testing 
programs without the purchase of more equipment and the ex- 
pansion of the machine room staff. This type of commitment 
might be undertaken if the Bureau could anticipate a steady 
volume of overprinting work. It is probable, however, that 
there would be much demand for this service in the early fall 
and late spring and little demand during the rest of the year. 
Thus, it is likely that the overhead costs would be prohibitive. 

It is believed that it would be desirable for public schools to 
experiment with the overprinting of answer sheets by means of 
their own facilities. 

^J. L, Stenquist. “Experiments with Machine Scoring of Tests,” Baltimore. 
Bulletin of Education, XIII (193S), 83-85. 




SELF-APPRAISAL OF TEST PERFORMANCE AS A 
VOCATIONAL SELECTION DEVICE^ 


GEORGE S KLEIN 
Tlic Menningcr Clinic 

The present paper will, first, describe a selection device 
based on a modified level of aspiration technique which was 
developed in the AAE Aviation Psychology Program during 
the recent war, and secondly, it will demonstrate its specific 
applicability and validity in an AAE occupational selection 
problem: namely, the piediction of success or failure in flight 
training of several hundred aviation cadets. It is implicitly 
suggested in the following discussion that the measurement of 
the appropriateness of self-appraisal of performance, that is, 
the gap between piedictions and actuality, may have two prin- 
cipal applications: it may provide useful adjuvant information 
in vocational selection programs where job analyses suggest 
that this aspect of ego functioning can be determinative of suc- 
cess or failure in certain occupations, and it may provide also a 
means of probing an important facet of ego functioning for 
clinical diagnostic purposes. Here, however, only its vocational 
application will be illustrated. 

Current personality theories essentially agree that an in- 
dividual’s evaluation of himself — his self-esteem — occupies a 
central position in the functioning of his ego, guiding the pre- 
dictions he makes concerning his behavior and influencing the 
goals he sets for himself. Indeed, the pattern of such self- 
evaluation is considered by some to reflect reliably certain 
features of the ego’s defensive structure itself (2, 3) and even 
its intrinsic strength or weakness. By this conception, ego 
structures are distinguished by characteristic patternings of 

^ This study was conducted as part of the AAF Aviation Psychology Program. 
The interpretations and opinions expressed are those of the author and do, not 
necessarily reflect the official ones of the AAF Aviation Psychology Program. 
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self-cstccin clcfi-nsTS which arc invoked for the I'lio's jirotcciion 
particularly in situations' of challenge or threat. 'I hese defenses 
are reflected in the tendency for the individual either to regard 
his capacities and achievements realistically or consi.stetifly to 
under- or ovcr-cvaluate them. Kxperimental investigation of 
this facet of ego functioning ('Vlf-cvaluation" or “self-esteem’*) 
has been gicatly facilitated by the level rd a.spiration tnethod, 
developed by Kurt Lewin and his a.ssociates, and refined more 
recently by others. One virtue of the meihod is that if lends 
itself to adaptation as a testing instrument with dearly deline- 
ated, quantitative indices of anticipated perfnimance, actual 
performance and final self-evaluation of performance, as well 
as indices summarizing the relations existing among rhe.se three 
aspects, Accordlngl}^ in developing a selection device the pre.s- 
ent study utilized one a.spect of the level of a.splratitm technique, 
namely, the measurement of the discrepancy hetween self-es- 
timates of performance obtained before and after given tasks, 
and actual achievement on the tasks ihem.selve.s'. 

Underlying the present application of the (e.st to an aitcrevv 
selection problem was a hypothe.si.s' which emerged from sev- 
eral job descriptions of the pilot’s functions; that the quality 
of appraisal of one’s performance is an important attnlmtc of 
success or failure in pilot flying training. In .seeking a measure 
of this factor in the selection procc.s.s, it wa.s' then further as- 
sumed that in a test situation sclf-cvaluation of te.st perform- 
ance would be distorted in accordance with the di,sposirion of an 
individual to exaggerate or depreciate what he is aide to do. 

Sufficient evidence is at hand in the literature to caution that 
for the latter assumption to hold good in a testing situation, 
both test performance and self-evaluations must he “ego-in- 
volved, that is, that these must he regarded by the subjects 
as having some intense personal significance. Previous .studies 
have indicated (4) that it is in only such a charged context 
that characteristic features of the ego defen.sive structure arc 
likely to come into play. Otherwise it would he as roa.sonable 
to propose that an individual’s evaluation of his performance 
m a test situation will closely parallel his experienced difficulty 
on the task. Whether or not such evaluations will be independ- 
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ently governed by personality variables lies in the significance 
they hold for him, either in that they may, in his eyes, poten- 
tially influence some vital change in his life situation and affect 
his achievement of vital goals, or m some other way represent 
a thieat or challenge with consequences extending beyond the 
experiment pioper. This atmosphere of ego-involvement per- 
vaded the AAF classification process of which the present test 
was a part, and the ratings themselves assumed the type of 
significance described. This characteristic of the testing situa- 
tion will be more specifically discussed below. 

Description of the Test 

To measure the pattern of an individual’s self-appiaisal, a 
simple rating procedure was developed and adminstered in 
connection with the routine psychomotor tests of the aviation 
cadet cla-ssification test battery. Each cadet estimated his 
performance before and aftei each of the 6 psychomotor tasks. 
One estimate was made bcfoie practice and one immediately 
after completion of the psychomotor test. These will be refer- 
red to respectively as pre-performance rating and post-perform- 
ance rating in subsequent discussion. On 4 tests a rating was 
obtainable after a practice period as well so that a total of 16 
ratings were made by each cadet. The 6 psychomotor tests 
were as follows: 

1. Aiming Stress Test: This was a steadiness task in which 
the cadet was directed to keep a stylus, held in outstretched 
hand, from touching the side of a narrow aperture, while verbal 
stimuli designed to “rattle” him were shouted by the examiner. 
The measure of unsteadiness was the amount of time the stylus 
made contact with the sides of the aperture as recorded auto- 
matically by electric clocks wired into the apparatus. 

2. Rotary Pursuit Test: In this test the cadet was required 
to manipulate a stylus in such a manner as to maintain contact 
between the point of the stylus and a target set on a rotating 
disk. Efficiency of performance was determined by measur- 
ing the time during which the cadet maintained a direct contact 
between the stylus and the target. 

3. Complex Coordination Test: This was a coordination 
test in which the candidate had to manipulate simulated air- 
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plane controls — a stick and a rud<UT h.u - in order to match 
three pairs of lights presented on a panel hefnre him. I'he 
measure of efficiency was the mnnher of matchings accom- 
plished within the 15-mirnUe leM period, 

4. 'fwo-hand CnordimKtntt TtH; 'I'his test recpiired an 
individual to coordinate the movements of hath hands in re- 
sponse to a target moving ai vaiying rales of speed along an 
irregular pathway. Contact had to he maintained between 
a metal button controlled hy two handles which the cadet 
manipulated and the moving metal target. The mea.sure of 
efficiency was the amount of time such contact was mnintained 
as recorded by the electric scoring clocks duting the scries of 
trials. 

5. Discrhnmution. Reactiou Tinu': 'rin's test was de.signed 
to measure the speed of ,s-eiective response to the spatial rela- 
tionships existing among 4 visual stimvili. 'fhe test required 
that the cadet make 4 diircrent manual reactions, depending 
upon which of the 4 pos'Ition.s in sptice a red and a green light 
occupied with respect to each other. 'I'he cumulative time 
taken by the candidate to make MO reactions (4 sets of 20 each) 
was recorded on the electric, clock and constituted his test vSeore. 

6. Finger Dexterity Test: In this test the sliced svith which 
the cadet reversed and inserted pegs into several rows of a 
pegboard was determined. Efficiency was measured in terms 
of the number of peg.s' appropriately placed during a given test 
trial. 

Each of the above tests was given to a group of 4 subjects 
at a time. For 4 tests the standard testing period consisted of 
an instruction period, practice trials, and test trials interspensed 
with 30-second rest periods. On 2 tests, Rotary Pursuit and 
Two-FIand Coordination, there wavS no practice period. The 
testing time for each task was approximately IS minutes. The 
sequence of tests was deliberately randomi’^ed within the group 
studied. Performance scores of all test.s were rendered com- 
parable by conversion to a standard distribution according to 
the conventional practice followed in the AAF classification 
program. 

The Rating Scale and Motivational Context: A 10-point 
sea e was devised for expressing self-ratings of performance on 
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the psychomotor tests. Instructions regarding its use on each 
task were read to the cadets hefoie they began the senes. In 
this scale, running from “very poor” to “very good,” the middle 
position, “average,” was divided, thus forcing ratings to fall 
either into above-average or below-average parts of the scale. 
It was believed that in thus forcing the cadet to commit himself, 
the procedure would provide a measure of a significant person- 
ality tendency. 

In any level-of-aspiration study, the type of instruction 
given and the motivational context or atmosphere of “ego- 
involvement” in which ratings are made are both crucial: they 
invariably affect the general direction of the ratings of the 
group of subjects and in part determine the range within 
which individual dilTciences occur. 

The instruction.s .stiessed the importance of a “realistic” 
attitude in predicting performance. This emphasis is illus- 
trated by the following excerpts from the instructions given 
the cadets. 


Very freipicntly, after taking a test, cadets remaik. “I 
did well on this test,” or “I think I did very poorly.” Often, 
even before they take a rest, they can size up whether they 
will do well or poorly. Now before taking a test you will 
tell us how well you think you will do, and after completing 
each tc.st, you will tell how well you think you have done. The 
purpose is to sec how accurately you can estimate your per- 
formance. We would like to find men who are realistic, who 
know themselve.s well and can judge accurately and frankly 
their own abihtie.s and performance. By “realistic” we mean, 
if you think you will be “very good,” jrankly say^“very good’’; 
if you think you will do very poorly, frankly say “very poorly 

A final paragraph admonished the cadets as follows: 

You may have heard about these ratings from other cadets. 
You may have heard, for example, that a certain rating is 
always “best” or “correct” regardless of what you think you 
will do or have done. But no one can know whether a high 
rating or a low rating is better. No particular estimate is 
always “correct” or “incorrect,” Remember, what counts is 
how close your cstimate.s are to what you actually do on the 
test Be frank; if you think your score will be high, or if you 
think It will be low, or if you think it will be somewhere in the 
middle, say so by marking in the appropriate box. 
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The instructions further emphasized to the cadet that 
accurate estimates even of poor performance, i.e., where the 
discrepancy between prediction and a low score was minimal, 
would gain him more credit in his final classification score 
than would high performance with greatly discrepant ratings. 
This stre.ss on “lealism” perhaps tended the group toward 
conservatism in making ratings, particularly .since they were 
given no objective signs m the form of scoie.s, to indicate how 
well they were actually doing. However, the instructions had 
the more important effect of underlining the independent sig- 
nificance of the ratings in the cadet’s final classification .stand- 
ing. In this way, the ratings became for him a.s crucially 
important as the task performance proper. Considering also 
the general atmosphere of high motivation, intense competi- 
tiveness and eagerness to qualify existing dining thi.s period 
of the war, wc may reasonably infci that all ratings were highly 
"ego-involved,” that they weie gathered in a signifieant .situa- 
tion in response to which the .system of self-esteem or self- 
evaluation defenses of the ego could come into play, and 
influence the trend of each individualks ratings. 

We emphasize this feature of “personal significance" in 
the testing situation becau.se it is one rarely if ever achieved in 
level-of-aspiration experiment.s. Generally these .studies have 
also overlooked the more specific and equally crucial question 
of how much significance the subjects impute to the ratings 
themselves, quite apart from the tasks. The mistake is usually 
made of assuming that because the ta.sks performed by the 
subject had personal significance for him (i.e., weic cgo-in- 
volved), that by this fact the latings or aspiration judgments 
based on these tasks had a similar significance. However, one 
frequently finds that where the ta.sk.s’ were cgo-involved, the 
aspiration ratings were not, the subject being aware of the 
purely experimental character of the ratings and hence of their 
fundamental irrelevance to the tasks (and, therefore, to him- 
self). In few level-of-aspiration experiments have .self-ratings 
themselves seemed to carry to the subject the significant impli- 
cations for achieving major life goals that were described in 
the present study. 
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Several other departuies fiom the usual level-of-aspiration 
procedures may be noted' (1) Although the tasks were un- 
faiTuliar to the subject he was asked to make pre-practice as 
well as post-practice ratings; (2) The subject was never given 
any objective information, actual or “faked,” concerning his 
performance; (3) The subject made his predictions and esti- 
mates in qualitative terms, rather than in terms of a quantita- 
tive score specific to each task. 

A final word concerning the motivational climate in which 
the study was conducted. The research was carried out during . 
the height of the war, in a period when the prestige connected 
with flight training and AAF officer-status was especially great 
and the consequences of failure, especially with respect to 
the type of combat assignment, particularly drastic. Aside 
from the popular allure and glamour associated with being an 
Ail Foices pilot, cadets weie influenced by popular conceptions 
concerning the hazards of combat and living conditions in 
other branches of the service, particularly the infantry. Since 
popular rumor held that it was usually to these services that 
cadets who failed at the classification centers were recruited, 
these conceptions probably further intensified the desire to 
succeed which was already present and also Indirectly con- 
tributed to the personal significance that the testing situation 
acquired. 

Validational Indices: The difference-score principle was 
employed for expressing the relationship between the expressed 
level of ability and actual performance. In the present instance, 
the difference scores were measures of discrepancy between 
expected level of performance (“Flow well I will do’ or How 
well I have done”) and actual achievement (standard score 
on the test). To permit this comparison, self-ratings were 
translated into standard score units comparable to those used 
for the psychomotor tests. The score representing actual 
achievement was then subtracted from the corresponding esti- 
mate of performance to piovide a difference score. 

The difference scores made by the cadets on each of the 
tests were transmuted to a 9-point scale, a scale value of 1 
indicating extreme underestimate of performance and a scale 
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value of 9 indicating extreme overestimate. 'I’liis score has a 
distribution function with a mean of 6 anti sigma of 2. Only 
the measures of cli.screpancy based on rating 1 (prc-perfonii^ 
ance) and rating 3 {post-pcrformdttrr) were selected for valida- 
tion.^ Each cadet had a total of 12 such .scoies, two for each 
test. 

The rating scale was admini.steied to cadet.s taking 
psychomotor tests. The validation gump ctiii.sisted of those 
numbers of this population who weie immediately assigned 
to pilot training, in all 243 cadets who eventually succeeded 
in elementary flight training, and 29 eliminees from this .stage 
of training. The validation criterion was success or failure. 
A total of 229 of the 606 cadets weie assigiuifl to later pilot 
training classes. The remaining 105 of the original group com- 
prised small numbers assigned to navigator and bombardier 
training and ahso those who were eliminated from cadet status 
at the classification center because their aptitude scores were 
too low to qualify them for any aircrew specialty.'' 

Results 

Biscrial correlations with pass-fail data were coinputecl for 
each of the difference scores. Since the standard score on the 
psychomotor test contributes in pair to the size of the difference 
score, it was considered desirable to hold constant (i.c,, partial 
out) this factor in estimating the validities of the difference 
scores and their independent contribution to the classification 
test battery. Thus, the correlations of the pre- and post- 
performance difference scores with standard petformance scores 
were obtained as well as other correlational data relevant to 
the computation of the partlalled validity coefficients of the 
difference scores. 

The unpartialled and paitialled correlation coefficients are 
presented in Table 1 along with the contribution of each dif- 
ference score to the battery. The additions to the multiple R 

will be recalled that on four teats predictions of perforrn.inee were also 
made immediately after the practice period, but these are not treated in the 
present study. 

second validation study was subsequently conducted on another much 
larger group but the results are as yet unavailable 
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are based on the partial r’s. It will be seen that 7 of the 12 
difference scores validate highly enough to add .01 to .05 to 
a battery validating .57 on the population employed. It 
should be noted that the present coefficients represent mini- 
mum validities, since no correction was made for the somewhat 
restricted range of the validation sample which resulted from 

TABLE 1 

Correlations of 12 Difference Scores and a Combined Weighted Score With Pilot 
Classification Scores and Pass-Fad in Primary Flying 
School (yp = 2«, Wo = 29)* 



Difference 

Score 

Correlations with 
Standard Scores 
Varying 

Correlations with 
Standard Scores 
Held Constant 

2 rbls-^^ j 

Contribution 
to Validity of 
December 1943 
Battery! 

Rotary 

Pre-P. 

-22 

-.30 

-.09 

-.24 

.04 

Pursuit 

Post-P 

-.13 

-28 

+ 02 

-22 

.05 

2-Hand 

Pre-P, 

-.33 

-.32 

+.10 

-.08 

.02 

Coord. 

Post-P 

-.37 

-.37 

-.04 

-.19 

03 

Disenm. 

Pre-P 

-25 

-IS 

-.08 

-.10 

00 

RT 

Post-P 

-.33 

-30 

-.22 

-.27 

.02 

Aiming 

Pre-P, 

-24 

-.19 

-.04 

-.14 

01 

Stress 

Post-P. 

-25 

-14 

-.11 

-08 

.00 

Finger 

Pre-P. 

-18 

-.15 

-10 

-.11 

00 

Dex 

F09t-P. 

-23 

-.23 

-.17 

-20 

.01 

Complex 

Pre-P, 

-45 

-33 

-.09 

-02 

.00 

Coord. 

Poit-P. 

-.43 

-33 

-.09 

-.05 

00 

Combined 
Weighted 
DifF. Score 

, 

-36 

-.45 

. . . 


.06 


* Code. Difference Score 1 

Standard Score 2 

Criterion (Pass-Fad) 3 


Combined Classification Battery Score .... 4 
t Validity of battery. .57. 

the elimination of cadets at the classification center. It will 
be lecallcd that initial selection occurred in terms of the psycho- 
motor test scores. Although there were not many such elim- 
inees represented in the original tested population of 606, this 
selective factor probably resulted in some reduction in the vari- 
ances of the difference score indices Consequently, it is pos- 
sible that a range correction which would allow for the absence 
of this low score group from the validation sample would 
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result in an increase in the estimated validities of the difference 
scores* 

A combined weighted score based on the difference scores 
was also validated on the same population, I'his combined 
score was determined by a.s.signing weights to the various 
difference scores according to the size of their respective 
contributions to the battery. For example, the difference 
score based on the post-performance rating (III) on Rotaiy 
Pursuit was assigned a weight of 5 since it yielded a contribution 
of .05 to the battery. The foinuila for obtaining the combined 
score was as follows: 

Combined score-- 5 X (Rot Pur: III) s *f , (Rot Pur; I) 
+ 3 X (2-hand Coord: III) 2 X (2-Iuind Coord: I)+l 
X (FingDcx; III) -|' 1 X (Aim Sirc.ss; I) -f 1 \ (Disc. R. T: 
III). 

The biserial correlation coefficient of the combined weighted 
score and its conelation with the combined classiHcation test 
scores arc also given in Table 1. It will he seen that the com- 
bined score adds .06 to tlic multiple R of the battery. 

In general, the negative direction of the cnellicieius indicates 
that with standard score held constant, cadets who overesti- 
mate their performance arc more likely to fail in primaiy 
school than those who underestimate their performance. 

Partly as a check on the partial correlations and also for 
the purpose of studying the degree of linearity of the difference 
score relationship to pass-fail data, it was' decided to employ 
another method of holding standard scores constant and to ob- 
serve the relationship of difference scores to graduation or elimi- 
nation. This method involved obtaining the frequency of 
graduates and eliminecs for each of the diffcience-score levels 
in each of the standard-score groups. For this the major break- 
down was standard-score; standard scores were grouped re- 
gardless of test. First, the standard scores of nil the psycho- 
motor tests were tabulated into groups of five; viz., 13-17, 
18-22, and so forth, up to 83-87, 10 groups in all. Then, the 

noted also that battery and test v.ilidincs were severely restricted 
by the fairly low reliability of the pass-fail criterion in the primary schools at the 
time this study was conducted. 
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actual per cent of graduates was computed for each of the 10 
standard-score groups. Each of the 10 groups contained enough 
cases to make the results statistically reliable. It was then de- 
termined to what degree the various difference scores falling in 
each one of the standard-score groups were associated with 
graduation or elimination, and their discriminative capacity 
was compared with that of the standard-scores. This was done 
by detei mining how much the percentage frequency of gradu- 
ates having each of these difference scores exceeded or was less 
than the actual per cent graduating in that paiticular standard- 
score group. For each difference score, the increment or dec- 
rement in per cent of graduates ovei or below that of the “ex- 
pected” percentage was obtained in each of the standard-score 
groupings; these lesidual percentages were then summed for 
each difference score. Thus, it was found, for example, that the 
percentage of men with difference scores of 9 who graduated 
was much less than the actual percentage of graduates in each 
of the standard score groupings in which they were found, 
Following this procedure for each of the nine levels of differ- 
ence scores in each of the ten standard-score groups, it was 
possible to determine to what degree a difference score was 
advantageous so far as graduation was concerned. In this way, 
also, this procedure provided an indication of the linearity of 
the difference-score relationship to pass and fail data. The re- 
sults represent an average relationship based on approximately 
3,000 difference scores. 

Figure I summarizes the relationship of each of the differ- 
ence scores to primary school performance, with standard 
scores held constant. The values of the Y ordinate in Figure I 
show the total percentage of graduates in excess of or less than 
the actual percentage of graduates in the standard-score cells 
in which the difference scores were found. It will be seen that 
the percentage of graduates with a difference score of 1 was 
found to exceed by 68 per cent the percentage of graduates in 
each of the standard-score groups. At the other extreme of the 
scale, it was found that the percentage of graduates among the 
8 and 9 difference scores is much less than the expected per- 
centage of graduates in each of the standard-score groupings 
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and can be regarded, therefore, as associated with failure in 
primaty school. It thus appears evident that a considerable 
underestimate of performance is more highlji' associated with 
success than any other level of self-e.stimate; conversely, a con- 
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WFrtRENce scones 

Figure I. Showing the relationship between the various Icvehs of 
discrepancy scoics to primary school success with standard score 
held constant. 

siderable overestimate is closely associated with failure in 
primary school. 

The data in this forrri substantiate the conclusions derived 
from the partial correlation coefficients and demonstrate, in 
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general, the linearity in relationship between difference score 
and success or failure in primary school. The relatively small 
number of cases in the final validation group {N = 212) limits, 
of course, the conclusion drawn from these data and may also be 
partly responsible for the rcveisal of the linear tendency in the 
middle part of the difFcrcncc-score scale 

Discussion 

The finding that underestimates of performance are associ- 
ated with success is of considerable interest. It may be that 
such low self-evaluations aie really indirect measures of motiva- 
tion. For example, a man with a wealth of drive and ambition 
may depreciate his immediate performance if he measures it 
against his own absolute standards, which are set high. Fie 
will rarely, if ever, come up to his own standard no matter how 
well he does. In the case of the overestimates of performance 
we may be seeing in operation a failure in self-insight which is 
detrimental to success. 

The results may be viewed also fiom the somewhat different 
vantage point of total ego functioning. This would relate the 
individual’s self-evaluations to the self-esteem defenses that 
are invoked in situations of threat and challenge (2, 3 ) . From 
this point of view, overly optimistic estimates of one’s achieve- 
ment may be a useful device to help protect the ego from con- 
templated effects of failure, especially if kept resolutely high 
despite poor performance. This would he the case in certain 
forms of neurotically disturbed egos which particularly require 
such inordinately rigid defensiveness; egos relatively free from 
the thwarting effects of neurotic conflict presumably have no 
such need. This view is expressed by Erickson (1): “A strong 
ego secure-k its identity does not need, and in fact is immune 
to any attempt at artificial inflation. Its tendency is toward 
the testing of what feels real; the mastery of that which works; 
the understanding of that which proves necessary.” 

It is reasonable to suppose that within certain dynamic 
settings consistent underestimates of performance may also 
reflect a self-esteem defense. It appears unlikely, however, that 
the underestimate tendency of the successful group in the pres- 
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ent studjr can be so interpreted. Such an interpretation would 
specifically imply that a neurotic quality which expres-ses itself 
in ^ need to “play down” one's efforts is conducive to successful 
achievement as a flier. In the pre.sent in.stance, therefore, it 
appears more reasonable to refer this trend within the succc.ssful 
group to the con.scrvativ(‘ hia.s induced by the rating in.struc- 
tions, rather than primarily to a charactcrological soutce. It 
will be recalled that the implicit empha.si.s on cautkm probably 
had some tempering effect, to a varying extent, on all indi- 
viduals tested. In such a situation, a “realistic" individual 
would characteristically tend toward conservatism or under- 
estimates in his predictions, the direction of the successful 
group. In the failure-group, on the other hand, pres.sing de- 
fensive needs might well have overcome the coinservative em- 
phasis of the instructions. P re.su m ably, were the instructions 
such that a “realistic” attitude could he expected to show itself 
consistently in zero-discrepancy score.s, one would find that 
the degref of overestimation characteristic of the failure-group 
would b’e much greater, and the degree of undere.stimation in 
the successful group would be much less, than was the ease in 
the present study. 

The fgregoing discussion provides little basis for explaining 
whythe difference s'cores varied so widely in validity or why 
some showed no validity at all. It may simply be that some 
of the tasks afforded no stable comparison or “anchoring” basis 
according to which an individual could relate his performance 
to that of other individuals or estimate his own progress during 
the test. It may be, however, that some tasks tend to call into 
play self-esteem defenses more readily than do others. It would 
seem from the results, also, that first and last ratings do not 
consistently bear the same significance from task to task with 
respect to ego factors or, more specifically, with respect to their 
relationship to self-esteem defenses. 

Unfortunately, the data gathered wei'c insufficient to clarity 
the dynamics underlying the trends described. Nevertheless, 
one generalization from the present findings is worth special' 
emphasis because of its practical implications: that in at least 
one type of vocational adjustment, the quality of appraisal of 
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one’s performance is an attribute of success or failure, and that 
the technique described aflFords a means for measuring it. This 
suggests that vocational testing programs may gainfully meas- 
ure this factor for predicting success in other occupations as 
well, especially where job analyses appear to indicate its 
relevance. This possibility offers a pattern for future research. 

Summary 

1. The present study describes a selection device based on 
a modified level-of-aspiration technique and its application to 
the prediction of flying school success or failure in a group of 
272 aviation cadets. 

2. Measures of discrepancy were obtained for each cadet 
between self-estimates of performance made before, during, and 
after each of 6 psychoraotor tests, and the standard scores he 
obtained on the test proper. The difference scores were ex- 
pressed on a scale of 1 to 9. Twelve difference scores, based on 
the pre-performance and the post-performance ratings, were 
validated. 

3. It was found that 7 of the 12 difference scores validated 
highly enough to contribute from .01 to .05 to a battery vali- 
dating .57 on the population employed. These additions to the 
multiple R were based on partial r’s, with performance scores 
on the tests themselves held constant. 

4. A combined weighted score, determined by assigning 
weights to the various difference scores according to the size of 
their respective contributions to the battery, was also validated 
on the same population. This was found to yield a contribution 
of .06 to the multiple R of the battery. 

5. In general, the direction of the relationship of self-esti- 
mates to performance in primary-school flying training appears 
to indicate that with standard score on psychomotor tests held 
constant, cadets who overestimate their performance are more 
likely to fail in flying training than those who underestimate 
their performance. 

6. It is felt that the promising nature of these results war- 
rants a wider application of the technique to problems of vo- 
cational selection in addition to its possible applicability to 
clinical diagnostic problems. 




A FACTOR ANALYSIS OF THE BERNREUTER 
, PERSONALITY INVENTORY 


GLENN C MARTIN 
Los Angeles City College 

The Bernreuter Personality Inventory is still one of the 
prestigious instruments of its type in the personality testing 
field) even since the advent of a number of otheis with better 
empirical validation, such as the Minnesota Multiphasic Per- 
sonality Inventory, or with better statistical ground-work, 
such as the Guilford Personality Inventory. In our efforts at 
the Counseling Service to make the best use of the best available 
tests, we were forced to consider the Bernreuter as a candidate. 

We thought of it rather distantly because of the mixed 
evidence of its value — for instance, a lack of agreement between 
the Inventory scores and the actual behavior records of malad- 
justment Feder and Baer (3) point out that 

Personality problems, arising only in the face of certain spe- 
cific cii cumstances, were frequently obscured by the generalized 
type of questions contained in the Inventory. Cases which 
should be lecommended for psychiatric treatment in terms of 
the norms, actually manifested problems of less seriousness 
than other cases given satisfactory adjustment ratings. 

Further, its failure to measure socially evident characteristics 
is criticized by Flanawalt and Richardson (4) who feel that 
self-sufficiency is distinguishable from withdrawal, and socia- 
bility (as evidence of social dependency) from gregariousness 
(as evidence of mature sclf-confidence with others), and that 
the Bernreuter blurs these distinctions. 

Usually the reliability of such inventories is determined by 
a measure of internal consistency, often yielding coefficients as 
high as .85 for the Bernreuter scales (10). These results, 
however, are much more favorable than test-retest measure- 
ments, reported by Sartain (8) to lie between .523 and .686. 
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Of course, the consistency of repentcfl DicaMiremcnfs is partly 
a function of the measured variable as well as the reliability 
of the measuring in.strumenf, so \vc cannot assume such a 
serious fault in the Bernreuter until we know more about the 
evanescence or stability tif personality tiualities. 

Another slighter difficulty lies in the method of indicating 
responses. Bermeuter use.s the question form, requiring “Yes,” 
“No,” or “?” answers. Feder and Baer (.?) point out that 
the rather general statements cannot he answered in such 
unqualified terms and still leave the feeling that an accurate 
personal description results. Of cour.se, it should he noted that 
logically it is quite po.s'sihle to get a quite satisfaertrry mea.s'ure 
without leaving that feeling. A peison unacquainted wdth 
X-ray technique might feel disappointed with a moment’s 
exposure to nothing visible without in the least interfering 
with the picture. This is .somewhat compar»ihlc to the virtue 
of face validity in an aptitude test — intwc do.siiahle with it but 
not invalidated without it. This whole issue will be enlightened, 
I am sure, by a current study by Kimber on Cluilfordls 
Inventory of Factors STDCR concerning the relative merits 
of statement and question items, and of two, three, four, and 
five categories for responses, as well as feelings of acceptability 
attaching to the different forms. 

A variant of this aspect of the Inventory is the problem 
of weighting responses. Bernreuter uses weights from -f- 8 
through 0 to — 8, the signs roughly indicative of the bipolar 
characteristic of the scales. McClelland (6) suggests reducing 
this 17 point continuum to a 7 point range, finding that the 
simplified scores correlate higher with the original scores than 
the split-halves of the latter do with each other, Bennett (1) 
goes even further, reducing the Bernreuter weights to the 
values, -|- 1 and -\- 2. 

We turn now to another more fundamental difficulty. Ex- 
perimental workers have found that the measurements by the 
various scales are not as separable as their titles. St. Clair and 
Seegers (7) state “The FI and B1 scores seem to measure nearly 
identical traits.” Feder and Baer (3) assert that the relation- 
ship “between and neurotic (Bl), introversion (B3) and sub- 
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missiveness (B4) and self-consciousness (FI) suggest wide- 
spread overlapping in these areas. Introveision (B3) and 
self-consciousness (FI) arc highly related as are extraversion 
(B3) and self-confidence (Fl), indicating fuither overlapping. 
Dominant traits seem to be associated with self-confidence to a 
high degree ” St. Clair and Seegers (7) found that B3 and B1 
are nearly identical, but otherwise found evidence for three dif- 
ferent trait measurements: neurotic tendency Bl, self-suffi- 
ciency (B2), and dominance (B4). These studies and many 
others leviewed by Super (9) point to the same conclusion that 
Flanagan arrived at 13 years ago: namely, that the Bernreuter 
scale titles are to a large extent fictitious, measuring mainly two 
discrete entities in personality structure. Flanagan used the 
Hotelling method where “the resulting descriptions of the n 
vaiiables are in terms of n common factors” (S), and which 
assumes communalities of unity. His results are shown in 
Table 1. 

TABLE 1 


Scale 

I 

II 

III-IV 

Neurotic Tendency 

887 

.228 

V-,023 

Self-Sufficiency 

-594 

648 

167 

Intro-Extroversion 

858 

321 

.084 

Dominance-Submission . . 

-.833 

112 

.358 


On the basis of this evidence Flanagan constructed two addi- 
tional scales, contending that they could well be substituted for 
the original four. 

Bennett (2), in addition to simplifying the weighting 
scheme, advocates using the two F scales as axes of measure- 
ment and then, on tables based on regression equations, looking 
up the most probable scores on the four B scales. He discards 
the descriptive value of the F scales, however, since these do 
not aid significantly in understanding an individual. This 
confirms Super^s feeling that the Bernreuter scales have been 
retained because of their colorful and familiar verbiage, while 
the Flanagan substitutes have been largely neglected from a 
lack of appreciation of their clearer rationale and better sta- 
tistical basis. 
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The purpose of this .study w;is to an;ilj7c a rnatiix which 
includes the Flanagan scales with a niethcid that has come to 
be mucli more widely accepted than the Hotelling; namely, the 
Thuistnne centroid method. Verification of Flanagan’s results 
would reduce the prtibahilitjf that .statistical aitifacts were 
being created, and at ibe same time give gieater confidence in 
an abbreviated treatment of the Inventory. 1 he raw material 
is the matrix given in the 193.s liernreuier manual. 

The rotated factor loading-s are shown in 'Fable 2- 

TABLE2 


Scale ■ 

Factor LoadinRs 

V.iri.incr 

Commmwlity 

li'J 

Unifutcacc'i 

II 


I 

n 

III 

P 

II- 

IIP 

Bl-N 

.998 

.081 

.045 

,!N6 

.007 

(K12 

1 0 

II 

B2-S 

-.412 

.747 

.094 

.170 

55.8 

00<l 

.717 

.2M 

B3-I 

,959 

,106 

234 

.920 

.Oil 

.055 


.014 

Bt-D 

-.829 

127 

.411 

.687 

.016 

.I6'l 

.872 

.128 

Fl-C 

.995 

-136 

-081 

.990 

.019 

.(KI7 

1,0 

0 

F2-S 

.198 

.820 

.301 

,039 

672 

.091 

.802 

.198 


The first point to note is the agreement with Flanagan’s 
factor loadings. He used only the original *l “II" .scales, so that 
the comparison Is not complete, but i.s .still striking. 

We have good reason to hold tliat factor I i.s the mo.st 
important in scale.s B1~N, B3-1, Bd.^-D, and I'T-C. If wc ac- 
cept the validity of the Bernicutcr scale descriptions, we must 
accept, too, the conclusion that whatever causes high scores on 
the neurotic tendency measure must also cause or be highly- 
correlated with the cause, of similarly high scores in introversion 
and self-consciousness. The negative loading.s on BZ-S and 
BT-D would indicate that this factor is inversely related to the 
causes of social dominance, and to a lesser degree, to self- 
sufficiency. That the two latter variables are not identical is 
shown by two bits of evidence: (1) factor II loading on B2-S 
is heavy, but vanishing on B4-D, (2) some third factor has 
an appreciable loading on B4-D but vanishing on B2--S. How- 
ever, there may be some overlapping, since the variance of these 
two scales is not fully accounted for by the three factors shown. 
Because of the location of its heavy loadings on Bl-N, B3-I 
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and Fl-C, we might tentatively entitle this factor I “Neurotic 
Self-Consciousness.” 

Factor II has the heaviest loading in a non-social or socially 
independent characteristic, with 'a second on self-sufficiency. 
The picture is not quite so clear here, but there is piobably 
reason for calling factor II "Social Self-Sufficiency.” 

It would be dangerous even to sugge.st any identification for 
factor III because of the low or vanishing loadings throughout 
the six .scales. (Parenthetically, the writer suggests that these 
factor titles be held very tentatively, pending some better vali- 
dation than correlation with “previously validated tests,” upon 
which Bernreuter’s claim for validity of the Inventory rests 
[see Manual^ page 4].) 

After evaluating the research evidence accumulated to 1942, 
Super (9) comes to a conclusion quite in line with the above 
factor definitions. 

The Fl-C continuum appears to consist of good contact 
with the environment as opposed to poor; the F2-S, of whole- 
some liking for contact with others in the environment as 
opposed to wliolc.somc liking for freedom from such contacts. 
The F scales arc thus concerned, the one with type of contact, 
the other with need for contact, whereas the B scales confuse 
type and need. 

Turning to the consideration of variancCj we can legiti- 
mately average the values under I and say that factor I ac- 
counts for 63% of the total variance of the 6 scales. Bl-N and 
Fl-C can be said to be completely composed of factor I with 
B3-I approaching this limit. Doing the same for II we get 
21%; for III, 6%; for U, 10%. Thus factors I and 11 include 
63% plus 21%, or 84% of the total variance. Adding factor 
III, we get 90%, leaving 10% for additional factors that might 
be present in B2-S, B4-D, and F2-S, for uniqueness not 
ascribable to any common factors, and for variance due to er- 
rors of measurement. Omitting column U because of the un- 
differentiated nature of its variance and column III because of 
the difficulty in identifying that factor, we see that still 84% 
of the effective measurement of the Inventory can be described 
in terms of factors I and II. 

There are four considerations in the choice of scales to 
represent the two factors. 
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They are, in order of importance; (1) purity, (2) inde- 
pendence, (3) reliability, (4) rationale. 

1. The comparison of loadings in Table 2 leaves no doubt 
that F2-6 is a much purer measure of factor II than any other 
scale. 

2. Independence refers to a relative lack of con elation of 
two variables with re.spcct to a third, so that fhi.s ciiterion docs 
not apply here. 

3. jR.eliablllty of scales related to factor II (fu)m the Bern- 
reutcr Manual ) : 

B2-S .92 (± .018)* .85 (rt 024) 

r2-S .78 (d:.039) 

* Standard errors added by the writer. 

While these results are not strictly comparable there is some in- 
dication that B2-S would offer sonic advantage in greater 
reliability, It should not be objected that test-rctest reli- 
abilities might be quite different, since we are interested in the 
single cross-sectional measurement. 

4. Rationale is placed as least important on the grounds 
that the empirical evidence has prior claim to consideration. 
If the correlation of the length of one’s great toe nail with one’s 
chances of getting to heaven can be demonstrated, I will ac- 
cept the prediction, regardless of the rationale. On the other 
hand, if the other three considerations have failed to differen- 
tiate, then that scale which is supported with the most adequate 
explanation, with all due respect to Occam’s razor, would he the 
most acceptable. As Super has pointed out, the F2-S scale has 
a clearer rationale, so deserves selection on a second count. 

Referring now to scales correlated with factor I: 

1. For purity, we can look back at Table 2. B3-I shows 
a distinctly Ibwer factor loading and variance for factor I than 
the two other scales, leaving Bl-N and Fl-C in the field. But 
here the diffeience is too slight to warrant a choice. 

2. Which of the two scales Bl-N and Fl-C should be se- 
lected depends on the degree of independence from F2-S. This 
will be determined of course, by the inter correlations. Look- 
ing back at the original matrix, we find the following; 

Bl-N and F2-S .32 
Fl-C and F2-S .11 
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3. The reliability coefficients for the scales correlated with 
factor I follow: 

Bl-N .91 (rh.02 ) 88 {±.02 ) 

B3-I .89 (±.025) .85 (±.025) 

Fl-C .86 (±.027) 

Since these coefficients were obtained from three different 
populations they are not directly comparable, but it can be 
seen that the Bl-N scale has only a questionable margin of 
superiority over B3-I and B3-I over Fl-C Other things being 
equal, then the most reliable measure would be the best choice. 
However, other things are not equal. 

4. On the matter of rationale, Super’s view is again offered 
as grounds for preferring Fl-C, giving it a second point of 
preference over its competitors. 

With reference to the mechanics of handling the Inventory, 
we facilitate our scoring by having the examinee mark a sepa- 
rate one-page answer form susceptible of complete scoring with 
four stencils (two positive and two negative). We use the 
Berm cuter weights, not because of objections to simplified 
techniques, but because that gives us direct access to the Bern- 
reuter norm data. This method retains practically the entire 
measuring value of the Inventoiy, preserves its maximum dis- 
crimination, and brings scoring to a practical compass. Be- 
cause of the two-factor manifold, graphing centile scores 
becomes easy in a two-dimensional space. The orthogonal re- 
lationship of the reference axes in the Thurstone method makes 
it proper to use rectangular scales in the graph, so we prepared 
a form using equal standard score intervals for the presentation 
of test results. 

Conclusions 

1. It should not be assumed that because the Bernreuter 
Inventory fails to distinguish self-consciousness from introver- 
sion, for Instance, that other measures, such as the Guilford, 
might not. 

2. The success in this study of separating factor I from 
factor II on orthogonal axes fails to support Guilford’s sug- 
gestion that oblique axes may be characteristic of anlyses of 
personality factors. 
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3. This study offers confiimation of the Flanagan analysis, 
and suggests that most of the measuring elfectivencss of the 
Inventory can be tapped with the I'T and F2 scales. 
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PUPIL PERFORMANCE ON THE IOWA EVERY-PUPIL 
TESTS OF BASIC SKILLS ADMINISTERED AT 
HALF-YEAR INTERVALS IN THE 
JUNIOR HIGH SCHOOL 

W. C, KVARACEUS and MARY A LANIGAN 
Bobton University 

There is general agreement that a continuous testing pro- 
gram, using different forms of the same test, will result in a 
more effective testing program. Wood’- suggests that any test- 
ing will have value to a school in direct proportion to the num- 
ber of times a test can be administered, thereby permitting a 
continuous study of pupil growth over an extended period of 
time. Such a program calls for tests that have many forms 
and a high degree of reliability. 

The customary conception of tests, as being essentially 
snapshot affairs to be given, scored, and acted upon at par- 
ticular moment and then forgotten, is now thoroughly dis- 
credited in all informed circles. . . . Only by an appeal to 
history can they be made to fit into the program at all. . . . 
During the last few years has developed a clearer understand- 
ing of the basic necessity of measuring growth over a con- 
siderable number of years, and a more adequate appreciation 
of the inescapable need for a systematic use of tests that yield 
comparable results. 

In keeping with this thought, some of the tests that have 
been published recently provide four or five forms. The Iowa, 
Every-Pitpil T ests of Basic Skills^ is an example of a widely 
used seiies of tests whose five forms permit a continuous test- 
ing of achievement on the same scale. 

In the Arlington, Vermont, elementary schools all twenty- 

^BenD Wood BtutcConsideralionstn Educational Tesimg Published by the 
Cofnmittee on Educational Testing, May, 1933 p. 4, 

^ Iowa Every-Puftl Tests of Basic Skdls. Boston' Houghton Mifflin Co 
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seven pupils completing grade six were tested, tising the Ad- 
vanced Iowa Every-Pupil Test, Form N. This* same group was 
then retested with other forms of the s*amc test at half-year 
inteiwals. The Iowa tests were selected for use because of their 
many forms, because of their diagnostic value, and because of 
their reported reliabilitj*.’ At the same time the Oih Qmck 
Scoring Mental Ability Test,* Beta form, was administeied in 
1943 and in 1945. The average of the.se two scores ha.s been 
taken as the best measure of the academic aptitude of the pupils 
discussed in this report. 

TAUI.1- 1 

Tests Adminhlcred to 27 Arltti/;lnn, Yermonl, Vuptit at Five tfalf-Year 
Intervals Depjnnini; at (trade (>.'S 


Test 

Form 

Date 

Grade 

Otis, Quick SconnB 


.Sept. l'H3 

6.0 

Otis, Quick Scoring 

Beta 

.Sept 1V4S 

8 0 

Iowa Every-Pupil . 

N 

June I'M3 

69 

Iowa Every-Pupil . 

0 

Jan. l'M4 

7.5 

Iowa Every-Pupil . 

L 

June l'M-1 

7.9 

Iowa Every-Pupil . 

0 

Jan 1945 

8.5 

Iowa Every-Pupil . 

M 

June 1945 

8,9 


The mean Otis IQ of this group was 104.35, SD 11.41, the 
standard error of the mean was 0.’44. The group i.s a near-aver- 
age sample of an entering junior high-school population and 
represented all of the children in the grade in this school system. 

Table 2 summarizes the means and the variability of the 
group of 27 pupils on each of the five sub-tests in the Iowa 
Battery, administered at half-year intervals from June, 1943, 
to June, 1945, This table reveals to what extent the tests 
reported increments of growth for the skills measured as well 
as the extent to which pupils tend to spread at each testing 
period. 

Assuming normal growth expectancy of grade increments in 
the skills measured during this three-year period, the gioup 
tested showed regular gains in Reading Comprehension, Vocab- 

^losiia, Etsery-Pupil Test, Supplement to Manual for Interpretation, Forms N, 
0, M, pp. 33, 52, 31. 

ITT Qsmk Scoring Mental Ability Test, Beta Form, Yonkcrs-on-the-Hudfion: 

World Book Company, 
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ulary, and Work-Study Skills. Increments in Language and 
Arithmetic are fairly regular except for the January, 1945, 
testing when regressions were noted. The possibility of such 
regression scores being obtained on a given group calls for con- 
tinous testing if hazards of misinterpretation of such group 
performances are to be avoided. 

TABLE 2 

Means and Standard Deviations of 27 Pupils, Grade 6 9S 9, Arlington, Vermont, 
Tested With Iowa Baste Skills Battery Forms 0, L, M, N, 0, 
Administered at Half-Term Periods, 

June, 1943-June, 1945 


Test 

Mean Grade 
Score 

Variability 

+ 1 SZ) -ISD 

Reading Compreh (June ’43) .. . 
Reading Compreh, (jan ’44) ... . 
Reading Compreh. (June ’44) .... 

Reading Compreh Gan ’45) . . 

Reading Compreh. (June ’4S) .. . 

7-1 

9-0 

5-0 

8-0 

9-9 

6-1 

8-5 

9-8 

6-6 

9-3 

10-0* 

7-3 

9-5 

10-0* 

7-8 

Vocabulary (June ’43) 

6-2 

7-5 

5-0 

Vocabulary (Jan, ’44) 

Vocabulary (June ’44) 

Vocabulary Gan ’45) 

7-3 

8-8 

5-9 

7-8 

9-0 

6-0 

8-3 

9-7 

7-0 

Vocabulary (June ’45) 

8-7 

10-0* 

7-4 

Work-Study Sk. (June ’43) 

6-3 

6-9 

5-9 

Work-Study Sk. Gan. ’43) 

Work-Study Sk, (June ’44) 

Work-Study Sk Gan. ’45) .... 

Work-Study Sk, Gune ’45) 

6-9 

7-9 

6-3 

8-3 

9-4* 

7-2 

8-8 

10-0* 

7-6 

9-1 

9-9 

8-3 

Language (June ’43) 

Language (jan ’44) 

6-9 

9-0 

5-6 

7-3 

9-5 

5-8 

Language (June ’44) ... . 

Language (Jan ’45) ... 

8-7 

10-0* 

6-7 

8-4 

10-0* 

6-9 

Language (June ’45) ..... 

8-9 

9-9 

8-3 

Arithmetic (June ’43) 

Arithmetic Gan ’44) 

6-5 

7-1 

6-0 

7-5 

8-7 

6-6 

Arithmetic (June ’44) .... 

Arithmetic (jan ’45) 

Arithmetic (June ’45) 

9-0 

10-0 

7-6 

8-7 

10-0 

7-5 

9-2 

10-0* 

8-0 

* Grade score equivalent above grade 10-0 and not 

available in norms, 

The relationship between 

the average Otis IQ’s 

and the 

total test performance of the 

group was 

also studied 

at each 


testing period. Many studies have been made comparing in- 
telligence test results and achievement test results. In Kohn’s® 


A Kohn “Achievement and Intelligence Examinations Correlated With 
Each Other and With Teacher's Ranking.” Pedagogical Seminary and Journal of 
Genetic Psychology, (1938), 433-4:37. 
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investigation a ini‘:m coi relation betwefti intelligence and 
achievement was .54. (late.s-'’ leported a relationship between 
school achievement and general intelligence fiom .47 to .05, 
with an aveiage of .54. Hj'rons and Ileninon’ reported a cor- 
relation between achievement and intelligence at the tenth 
year of school at .390. Another correlation hetween school 
achievement and the scores on the Otis Intelligence Tests le- 
portod by Ames'’ was ,54. Over a {)crio<l of three, yeais a co- 
efficient of correlation lietween achievement tmd the Oti.s In- 
telligence Tests was .52 as reported hy Kreuger, ('I'he aver- 
age IQ of the last reported group was 110.) 


•l AIM.K > 


Caffelaliati between f)lii .S.'l, Averantil IfJ't .iriJ Ifti-i Bittit HkiHr S’ub-'J'ejl 
Scores oj 27 1‘upili, (ir,iile l>M ,V'A , 1 ! tin'- 

tldl-Ycnr Inlcrvulx, Jvr.r, I'lti-lwne, 


Test 

Form N 

Form 0 

Junc'+.l 
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Reading Comnreli 
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.81 

Vocahuiaty 
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.61 

Work-Study 
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72 

Language 
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61 

Arithmetic 

... .27 

.88 
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Form f) 

Form M 

Mean 

June '44 

.Lin '45 

June '45 
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.75 
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78 

,74 

77 


.72 

..52 

.79 

.87 

.73 

.41 

rn 

.68 

,W) 

,57 
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56 

.59 


In the first battery of tests administered in June of 1943, a 
correlation between the averaged Otis Intelligence scoics and 
Reading Comprehension was .70; with Vocabulary, .77; Otis 
IQ’s and Work-Study Skills, .75; with Language, .66; and a 
correlation of .27 with Aiithmctic and the averaged Otis scores, 
The second set of tests, Form 0, administered in January, 

1944, maintained a consistently higher coirelation than those 
previously repoited. Similar results can be noted in Test 
Form L, administered in June, 1944, Test Form 0, administered 
in January, 1945, and Test Form M, administered in June, 

1945, with three exceptions, maintained a consistently higher 
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correlation than reported by previous investigations in this 
field. 

The mean correlation between Reading Comprehension and 
the Intelligence Tests resulted in .78. The mean correlation 
between the Vocabulary Test and the Otis Intelligence test was 
.72; the mean "r” of Work-Study Skills and Intelligence was 
.73; between Language and Intelligence, .60; and the mean “r" 
between Arithmetic test scores and the Otis scores was .59. 

Considering the factor of homogeneity and the small size 
of the group, these correlations may be considered sizable and 
significant. Apparently the factors that are operating in the 
test performance on the Ous Quick-Scoring Test of Mental 
Ability, Beta, are also present to a considerable degree in the 
Iowa Battery. 

Since the Otis Test is largely a reading test, the high rela- 
tionship between the two tests is to be expected since the Iowa 
tests are also reading tests. The lowest correlations were ob- 
tained between Arithmetic scores and the Otis IQ’s. However, 
even this correlation was as high as most correlations reported 
in the literature between tests of “Intelligence” and tests of 
achievement. 

The correlations between sub-tests of the same and differ- 
ent forms were computed and compared in Table 4. The rela- 
tionships between the different forms of Vocabulary and Work 
Study Skills are higher than the relationships between the dif- 
ferent forms of Reading Comprehension, Language, and Arith- 
metic. The correlations between Reading Comprehension and 
Vocabulary, and Reading Comprehension and Work-Study 
Skills are consistently higher than between Reading Compre- 
hension and Language and Reading Comprehension and Arith- 
metic. Generally the- Arithmetic scores correlated less with 
Arithmetic scores on the other test forms than did scores on the 
Reading, Vocabulary, Work-Study, and Language Tests. 

Sixty-one of the 300 measures computed represent marked 
relationship; in two instances a correlation of 1.00 was obtained, 
and m one, a value of - .22. The remaining cases represent 
some degree of relationship. 

The Iowa tests show that there is a strong tendency for 
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individuals to maintain relatively the same rank from one half- 
year to the next. This tendency varies with the subject area 
in which the pupil is tested. Adeq^uate interpretation of an 
individual’s peiformance at any given testing period is not 
possible unless reports of previous testing are available. 

Summary and Conclusions 

1. This is a report of the continuous testing of 27 Arlington, 
Vermont, pupils from June, 1943, to June, 1945. The group 
represents the total grade enrollment of pupils tested at half- 
year intervals using the various forms of the Iowa Every-Pupil 
Tests of Basic Skills. 

2. The average IQ of the group tested was 104.36 SD 11.41. 

3. The mean correlations between the Otis results and the 
sub-test scores were as follows: with Reading Comprehension, 
.78; with Vocabulary, .72; with Work-Study Skills, .73; with 
Language, .60; and with Arithmetic, .59. These correlations 
are considerably higher than those reported m the literature 
and indicate that the factors which operate in test performance 
on the Otis are also present in determining the pupil’s perform- 
ance on the achievement tests. 

4. Most of the sub-tests reported fairly regular increments 
from one-half year to the next. However, regressions were 
noted in Arithmetic and Language tests. An adequate inter- 
pretation of the test performance of a group at any period is 
possible only when the group has been tested previously. 

5. Correlations between successive performances on the 
same sub-test are not high enough to enable an accurate pre- 
diction as to rank from one-half year to the next. However, 
a strong tendency has been noted for individuals to retain 
their approximate position in the group from one testing period 
to the next. This tendency varied with subject matter. It 
was highest with Vocabulary and Work-Study Skills and lowest 
in Reading, Language, and Arithmetic. 

6. Correlations between different sub-tests in most cases 
revealed a tendency for the individual pupil to maintain the 
same relative position in the various skills measured. Differ- 
ences in the strength of this tendency are to be noted according 
to the subject matter area. 
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7. Because of the many variables that operate in measure- 
ment of human behavior and because of the maccuiacies of the 
test instruments themselves, an interpretation of the lest per- 
formances of an individual or group can be cautiously safe- 
guarded only when viewed against preceding perfoiinances on 
the same instrument. Otherwise the hazards of enoneous 
interpretations arc great. 



TESTING OCCUPATIONAL TRAINING AND 
EXPERIENCE 

HOMER T EOSENBERGER 
TJ. S. Bureau of Prisons 

Introduction 

The testing of occupational training and experience has long 
presented a difficult problem. All too frequently persons claim- 
ing qualifications in an occupation are not able to perform 
satisfactorily the duties required by that occupation. It is 
possible for a person to complete specified courses of training 
with satisfactory marks, to obtain necessary certificates and 
licenses, and even to obtain satjsfactoiy job ratings, yet be 
unable actually to perform well the typical duties of the occu- 
pation. 

In testing occupational training and experience the United 
States Bureau of Prisons faces many problems which it is at- 
tempting to solve through the use of a unique series of “per- 
formance tests.” The series may prove to be a satisfactory 
answer to these problems. It is recognized, however, that the 
Bureau’s personnel testing program based on this series has 
some shortcomings. This testing program needs follow-up and 
further research before an adequate evaluation of it can be 
made. 

The great variety of activities involved in administering a 
federal penal institution call for skills associated with at least 
35 specialized occupations. The Federal Prison System oper- 
ates 27 institutions located in 21 states and the District of 
Columbia. Standards of occupational training and job per- 
formance vary from state to state. In the Federal Prison Sys- 
tem employees are appointed as Correctional Officers for a 
probationary period during which they receive the training 
necessary to give them “prison experience. In the recruit- 
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ment of Correctional Officers at the entrance salary level the 
incentive of promotion is offered to those who have qualifying 
experience for any of these specialized occupational fields when 
they have acquired experience in prison work. 

In a federal prison one finds six “services” or departments, 
each responsible for a part of the total program of the institu- 
tion. During a new employee’s first week of dut)'^ lie is given 
one week of orientation training so that he may become ac- 
quainted with the six services and with his fellow workers. 
During the next three weeks he receives intensive training, 
based mainly on an assignment to each of the six services. The 
main objective of this basic training is to teach the trainee 
(new employee) how to supervise prisoners and how to acquire 
a working knowledge of the functions of each of the services m 
the institution 

During the training period new employees are given an op- 
portunity to demonstrate their ability to perform specialized 
functions. This opportunity is provided by means of per- 
formance tests based on 35 occupations. These tests are being 
administered uniformly in all 27 institutions and were used ex- 
perimentally in 10 institutions before being used on new em- 
ployees. 

Object of These Tests 

The object of the performance tests is to determine by the 
shortest, simplest and most direct way whether a new employee 
claiming training or experience in an occupation iclated to 
prison work has enough knowledge and skill in the occupation 
to warrant a two-week trial assignment in the service to which 
the test applies, to give a reasonable demonstration of his 
abilities in the occupation They are devised in such a way 
that a tradesman can demonstrate, with his own hands and with 
tools and equipment, proficiency in his trade and a professional 
person can demonstrate more than mere bookmindedness. 
The tests, however, make no pretense at evaluating intelligence, 
educational achievement, judgment or personal adaptability 
for the occupation to which each test relates. The tests are 
being used as one step in a training and promotion plan for 
personnel in the Federal Prison System. 
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Occupations and Fields oj Work to Which the Tests Relate 
In the Federal Prison System the related functions per- 
formed rn an institution ate grouped as six “services.” The 35 
occupations having application to federal prison work and for 
which performance tests have been prepared are grouped under 
the six services as follows: 


Administrative 
Bookkeeper 
Clerk Stenographer 
Storekeeper 
Typist 

Advisory 

Libraiian 

Recreation Instructor 
Social Worker 
Teacher 

Culinary 

Baker 

Cook 

Custodial 

Barber 

Firearms Instructor 
Physical Training Instructor 

Farm 
Dairyman 
Swine Plerdsman 
Vegetable Gardener 


Mechanical 
Auto Mechanic 
Blacksmith 
Bricklayer 
Bus Driver 
Cabinet Maker 
Carpenter 
Cement Worker 
Electrician 

Engineer (Power Plant) 

Laundryman 

Machinist 

Painter 

Plasterer 

Plumber 

Sheet Metal Worker 
Steamfitter 
Shoemaker 
Truck Operator 
Welder 


Type of Test 

Each performance test in the series calls for the actual per- 
formance of jobs typical of the occupation to which the test 
relates. No trick questions or novelties are included. Each 
test is devised in such a way that a person experienced in the 
occupation on which the test is based can reasonably be ex- 
pected to complete the test within a two'-hour period. 

Typical jobs included in the tests are as follows: for a 
Plumber' caulk a cast iron pipe joint with lead; for a Firearms 
Training Instructor- plan firearms instruction for a one-hour 
period and actually instruct a group of men after planning the 
instruction; for a Bookkeeper: prepare journal entries to record 
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specified transactions, post to ledger sheets and prepare a pre- 
closing trial balance; and for a Cook: prepare and serve a meal 
for four persons. 

Jobs to be performed in each test are selected with the view 
of making them as nearly representative of a wide range of 
principles involved in the occupation as possible. For instance 
in a trade such as Painter, mixing of paint, preparing surfaces 
for painting, painting nariow work, estimating, and staining, 
each involve an important principle on which the trade is based. 
Therefore the person taking the performance test for Painter is 
required to mix paint for particular kinds of surfaces and to 
match a specified shade, to estimate the number of gallons of 
paint necessaiy to put two coats of paint on the exterior of a 
designated residence, and the like. In order to pcrfoim within 
two hours a wide range of jobs typical of an occupation, the 
person taking a test such as for Painter is asked to mix and put 
a priming coat on only two squaie feet of surface, to prepare 
but one sash for painting, to putty but one pane of glass, and 
the like, on the theory that if he can demonstrate familiarity 
with the operation once he can demonstrate it later in moie 
detail when given a trial assignment on production work. 

In preparing each test a careful attempt was made to in- 
clude items just sufficiently difficult so that a person with in- 
adequate training or low-grade work experience, or one who is 
“bluffing,” cannot perform the jobs satisfactorily. The follow- 
ing typical items taken from the Perjormance Test for Carpen- 
ter quickly eliminate men with insufficient training or experi- 
ence but present no difficulty to a competent Carpenter: 

Take a piece of 2" x 6" lumber about 3 feet long and cut one 
end for the plumb cut (top end) of a one-balf pitch loof rafter. 

On the other end make the seat cut for a rafter of the same 
pitch to fit over a 4-inch wall plate, and to extend for a 12-inch 
eave. 

Lay a few pieces of finish flooring. 

Install one pair of butt hinges (4 half hinges) on 2 pieces of 
straight 2" x 6" lumber 6 feet 8 inches long, binging them to- 
gether as if one were the hanging stile of a door and the other 
were a door jamb. Give hinges the customary spacing. 

With pencil lay out on a board 12 inches wide the cuts neces- 
sary for a supporting stringer (stair horse) of a stairway to 
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rise 9 feet in a run of 12 feet. For the purpose of this item 
of the test it is sufficient to lay out only two treads and two 
risers. Determine by yonr own methods the height of riser 
and width of tread 

In order to be certain that the person taking a performance 
test has some basic theoretical knowledge of the occupation, a 
small amount of written work is called for by the test. A 
trainee taking the Electrician Performance Test is asked to 
draw a wiring diagram for a three-way switch and a wiring 
diagram for a four-way switch on a lighting circuit. The per- 
formance test for Auto Mechanic calls for the writing of the 
usual reasons why transmissions 3 ump out of gear. The Steam- 
fitter Performance Test calls for a sketch showing fittings and 
valves m the installation of a steam reducing valve with by pass 
and an explanation of how water hammer can be avoided in a 
steam heating sy.stem for a two-story dormitory 40' X lOT, 
connected to a steam line extending to a central steam plant. 

How the Tests are Being Used 

The performance tests have been developed to measure the 
qualifications of trainees in the above listed 35 occupations re- 
lating to prison work. The tests are a part of the new em- 
ployee’s Basic Training Course. When the employee enters on 
duty he files information concerning his previous training and 
work experience. He will be eligible to take one performance 
test on condition that 

(1) his training or experience or both relate to an occupa- 
tion on which a test is based. 

(2) he indicates a desire to specialize in that occupation. 

(3 ) the Bureau considers him qualified to take the test, 

When these three conditions are fulfilled the Bureau sends 

to the institution where the trainee is on duty a copy of the per- 
formance test for the occupation concerned, and directs that 
the test be given the trainee by a person qualified in the occu- 
pation represented by the test. 

The test is given at the end of four weeks of full-time basic 
training. If the trainee fails the test he is placed on 
custodial assignments. If he passes with a rating of Good 



106 EDUCA.TIONAL AND PSYCIIOI-OCICAL MEASUREMENT 


or better he is given a two-week trial assignment to special 
tasks in the occupational field in which he passed the perform- 
ance test, This two-week trial period is in a sense a continua- 
tion of the performance test. During these two weeks the new 
employee is given an opportunity to demonstrate that he is 
able to apply his skill and knowledge in the prison cuviionraent. 

These two weeks constitute an important assignment for 
observation purposes. During these two W'ceks of specialized 
work assignment the trainee is placed on pioduction work in 
much the same way as a trained employee except that stress is 
laid on ability to demonstrate a wide range of representative 
technical skills rather than on supervising prisoners on the more 
usual operations called for on the particular assignment. 

The tasks given the trainee during this two-week trial period 
are the kind that actually test his ability to do the work himself 
and that will enable the Supervisor under whom he works to 
determine the quality of his non-supervisoiy services. He is 
assigned to intricate tasks in his field that need to be done, not 
simply to routine duties. By observing his performance dur- 
ing the test and during this two-week follow-up period of pro- 
duction work the head of the service in which the testing is 
done can obtain a reasonably good idea of the trainee’s abilities 
and of the likelihood of his qualifying for eventual promotions. 

The trainee is rated when he completes the test. The two- 
week trial period which follows a successful test is simply for the 
purpose of affording the Supervisor responsible for the particu- 
lar type of work an opportunity to observe the trainee in actual 
daily performance. The rating given the trainee as a result 
of the test is sent to the Bureau of Prisons for record in the 
Placement Unit, and if his seivices are satisfactory (rated 
“Good” or better) during the two week’s assignment the Bu- 
reau places his name on an eligible list of employees to be given 
an opportunity to participate in a competitive examination 
after the necessary prison experience is acquired. 

For example, a trainee showing a rather extended training 
or work experience record in power plant operation and an in- 
terest in power plant operation will take a performance test 
after he has completed his four weeks of Basic Training in 
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prison work. If he passes the performance test he will be put 
on technical but non-supervisory production work in the power 
plant for a two-week peiiod. His test rating and his two-week 
trial period rating will both be forwarded to the Bureau and 
he will then be placed on an eligible list for a promotional ex- 
amination if both these ratings are “Good” or better. 

Method of Preparing the Tests 

Each of the 35 occupations for which performance tests were 
prepared were studied in detail — the occupation in civilian life 
and its counterpart in the Federal Prison System. These data 
were secured by consulting the United States Employment 
Service’s Dictionary of Occupational Titles, and other standard 
published sources of occupational information, textbooks and 
manuals giving technical information about trades and profes- 
sions, by analyses of jobs in the Bureau’s institutions, and by 
consulting specialists on the Bureau’s Washington Staff and in 
its institutions. 

In preparing the tests, m order to be fair to all persons with 
appropriate training and work experience, a general practice 
was made to include only such specific test operations (jobs) 
as the occupation in civilian life, in all parts of the country, calls 
for, regardless of whether the counterpart occupation in the 
Federal Prison System calls for those operations. 

As an example: The principal responsibility of a Physical 
Training Instructor in a Bureau of Prisons institution is to 
teach Correctional Officers to master defensive tactics, whereas 
Physical Training Instructors in civilian life are apt to spend 
much of their time either administering corrective exercises or 
coaching athletics. Many may have no specific knowledge of 
defensive tactics. Therefore, in preparing the Physical Train- 
ing Instiuctor Performance Test no requirement concerning de- 
fensive tactics was included. Instead, the test calls for plan- 
ning physical instruction for a twenty-minute period for various 
types of persons, and for actually instructing a heterogeneous 
group for a twenty-minute period. It is assumed that if a 
trainee can successfully conduct this type of ins.truction he can 
readily learn to teach defensive tactics. 
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In some instances where jobs are typical of an occupation in 
civilian life but foreign to the counterpart in the Federal Prison 
System those jobs were not used as test operations. For ex- 
ample, unlike most farmers, employees of the Farm Service in 
the Bureau’s institutions have practically no marketing prob- 
lem. Their products are consumed in the institutions. There- 
fore no particular emphasis on marketing operations is found 
in the three performance tests relating to the Farm Service. 
In the Storekeeper Performance Test no packing and crating 
or car-loading jobs are included as prison Storekeepers do little 
shipping. In the Shoemaker Performance T est the jobs were 
confined to the repair of men’s woik shoes due to the fact that 
practically all shoe repairing in the Bureau’s institutions is 
confined to men’s work shoes. 

Along with the selection of jobs that wcie to be performed 
m each test a rating system was devised. This was based on 
the federal government’s standard method of rating the effi- 
ciency of its employees. This standard rating method was ap- 
plied to the performance tests due to the fact that it is a 
method already understood by the supervisory employees who 
are charged with administering the tests and because of the 
simplicity of this rating system. Six elements were selected 
from the standard form used in rating all federal employees. 
These six elements are used on all 35 tests, with slight exception. 
The six rating elements are as follows : 

Skill in the application of techniques and pro- 
cedures 

Presentabihty of work (appropriateness of ar- 
rangement and appearance of woik) 

Attention to pertinent detail 
'Accuracy of final results 

Rate of progress on or completion of assignments 
Initiative 

In order to guide the persons giving the tests, illustrations 
of both outstanding and weak performance under eacli of the 
rating elements were prepared for each of the 35 tests. Per- 
sons giving the tests are cautioned that these illustrations arc 
merely illustrations and that it is the responsibility of the per- 
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son giving the test to determine whether the tiainee’s perform- 
ance should be rated "outstanding”, “weak”, or “adequate” on 
each of the six elements. The following are samples of the 
illustrations : 

AUTO MECHANIC PERFORMANCE TEST 
Skill 

outstandmg Used combination socket wrench and screw driver in adjusting valves 
toeak Used a pipe wrench in tightening and loosening engine head bolt 

Perlineiit detail 

outstanding Selected all necessary tools before beginning each job. 
weak Lighted matches near oil, grease and gasoline 

Initiative 

outstanding Checked the condition of brake lining and filed down any protruding 
rivets or recommended that brakes be relined before vehicle is used again. 

weak Did not inspect breaker points for pits and burns 

Space is provided in the test for jotting down during the 
test comments concerning the trainee’s performance with the 
thought that such comments will be useful in rating the trainee 
after the test is completed. 

The tests are assembled in two parts. One part, intended 
for the person giving the test, gives instructions as to how the 
test shall be given and rated, and provides space for comments 
on the trainee’s performance. The other part is for the trainee 
who takes the test. It indicates the jobs he is to perform, tells 
him who will give him the test and provides space for the small 
amount of written work that is required. 

Ten of the tests were tried out experimentally in ten in- 
stitutions, by correspondence, with the hope that institutional 
officials would make suggestions for improvement. The re- 
sults were somewhat disappointing. The next step was to 
visit several institutions and to try out the tests under care- 
fully controlled conditions. This second attempt to validate 
the tests was satisfactory and produced two types of improve- 
ments, (1) deleting some jobs and adding others to keep the 
tests within a two-hour completion range and on a completely 
practical level, and (2) adding illustrations of outstanding or 
-weak performance that were rnore technically appropriate than 
some of the original illustrations that were used. 
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Before each experimental use of any test m the scries a care- 
ful study of the Bureau’s personnel records was made in order 
to find employees who seemed to possess qualifications m the 
occupations on which the tests were based. In visiting the in- 
stitutions this study was supplemented by interviewing all em- 
ployees considered as candidates for the test. No pcison was 
permitted to take more than two tests and in most instances 
not more than one test. So that persons taking the test would 
not have an advantage over new employees for whom the tests 
were being devised, so far as possible the tests were adminis- 
tered only to persons who had never been assigned, since enter- 
ing the Federal Prison System, to the occupation on which each 
test was based. 

On the basis of experimental use of the tests, by cone.spon- 
dence and “on the ground,” revisions were made and the tests 
were mimeographed. The two-part character of the test and 
the six-element lating system were retained. The fiist part of 
each test, for the person giving the test, averages five pages in 
length. The part foi the trainee, in most tests, is reduced to 
one page, both sides being used. 

Method of Giving the Tests 

The tests are given only in the institutions of the Federal 
Prison System. Each test is administered by the Manager of 
the service to which it applies or by one of his Assistants. Thus 
the performance test for Swine Herdsman is administered by 
the Manager of the Farm Service or by his Assistant in charge 
of swine, and that for Baker by the Manager of the Culinary 
Service or by his Assistant in charge of the bakery. Perform- 
ance tests in any of the shop trades aic administered by the 
Manager of the Mechanical Service or by the Assistant in 
charge of the shop to which the test relates — sheet metal, weld- 
ing, and the like. This arrangement assures that each test will 
be administered only by a supervisory employee qualified in the 
occupation for which he is testing. 

Since it is necessary to observe very closely the performance 
of each trainee tested, tests are administered to only one trainee 
at a time. The individual administering the test is completely 
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responsible for it and for rating the trainee’s performance. Per- 
formance tests for such occupations as Bookkeeper and Typist 
may occasionally be administered simultaneously to more than 
one person, but even here it is probably desirable that these 
tests be administered to only one person at a time. 

Each of the tests in the series requires some pieparation on 
the pait of the person who is to administer it. He must first 
read it through. Then he must secure a suitable place to ad- 
minister it — a location away from curious eyes. He must as- 
semble whatever equipment and supplies may be needed and 
see that equipment is in working order so that when the test 
is started the trainee will not be interrupted. Preparation for 
most of the tests requires only IS to 30 minutes but it is essen- 
tial that It be completed in every detail. The effectiveness of 
a performance test can be virtually nullified by a combination 
of two or three neglected details. Failure to start the test in 
sufficient time to complete it before a shop or other place in 
which it IS given must be closed for the day, and failure to see 
that there is gasoline in the tank of a mixer that must be oper- 
ated by the trainee taking the Cement Worker test can cause 
much annoyance and unsatisfactory test results. 

In order to do worthwhile testing it is necessaiy to put the 
trainee at ease. Pie is told that since he is to be tested he must 
be rated and therefore must be observed, but it is also pointed 
out to him that we are interested m seeing him do his best on 
the test. In order to minimize tenseness on the part of the 
trainee, nothing is said to him or in the test about a time limit. 
It is also pointed out to him that the test is made up of jobs 
that are familiar to anyone experienced m the occupation on 
which it is based and that written work is not overemphasized. 
This approach usually puts the trainee in the proper frame of 
mind to get off to a good start on the test, especially if he is not 
particularly “book-minded.” 

Unlike paper and pencil tests, this senes of tests requires 
close observation of methods of performance during the testing. 
It is important that the Supervisor should know exactly how 
well the trainee handles tools and equipment or how he explains 
details to a group. Neither his skill, nor his attention to per- 



112 EDUCATIONAL AND I>SYCU0L0G1CAI< MEASUREMENT 


tinent detail nor his accuracy can be deterinincd satisfactorily 
meiely by examining the finished product at the end of the test, 
even though the final product may be a batch of finished laun- 
dry or the test scores attained by a gioup of men he has in- 
stiucted. 

By jotting down running comments on the trainee’s per- 
formance, during the test, the person giving the test has an aid 
at hand when rating. These comments concern things that 
do not show up in the final pioduct, things that might be for- 
gotten by the time the test is completed, such as special little 
devices and procedures to attract attention and present a point 
graphically that may have been used by a trainee in a perform- 
ance test foi an instiuctor-type occupation. 

The person giving the test follows the regular procedure in 
using the federal govcinmcnt’s standard efficiency rating form. 
He reviews the trainee’s perfotmance. He has at hand the il- 
lustrations of performance on the six rating elements included 
in the test and his running comments on the trainee’s perform- 
ance made during the time of the test. In rating the trainee 
on "accuracy” a thoiough examination is made of the visible 
product of the test — such as a paint job, a saw cut, or a gluing 
job. The amount of time required to complete the test is of 
course taken into consideration in rating him on "rate of 
progress." 

After the person who gave the test ha.s made a study of the 
trainee’s performance in terms of each of the six rating elements 
he assigns a -\- (outstanding), \/ (adequate), or — (weak) 
rating on each element. On the basis of these individual rat- 
ings he makes a final rating following a formula prescribed on 
the standard form. The ratings fall into five categories, as fol- 
lows; Excellent, Veiy Good, Good, Fair, Unsatisfactory. 

Some Preliminary Results 

In a typical institution of the 'll in the Federal Prison Sys- 
tem, 16 different trainees have taken a total of 18 performance 
tests, in 12 occupational fields. The ratings were as follows: 

Auto Mechanic — Very Good, Excellent, Excellent, Excellent 

Bookkeeper — ^Unsatisfactory, Unsatisfactory 
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Bus Driver — ^Very Good 

Cleik Stenogiapher — Fair 
Machinist — Fail 

Painter — Good 

Steamfitter — Unsatisfactoiy 

Storekeeper — Good, Very Good 

Swine Heidsman — Good 

Truck Opciatoi — Excellent 

Typist — Fair 

Welder — Good, Excellent 

The trainees who leceived the six ratings of Unsatisfactory 
and Fair were not eligible for the two-week trial assignment 
period to prove fuither their specialized naming and experience. 
Of the 12 trainees who received ratings of Good or better, nine 
have already been given the two-week trial assignment; eight 
of them completed it satisfactoiily, one did not. 

In taking a look at one particular test, the one for Store- 
keeper, which deals with warehousing, we find the following: 

On the basis of training oi experience 46 trainees in 14 insti- 
tutions have qualified, to the satisfaction of the Bureau in 
Washington, to take the test. The test has been given to 24 
of these men in 11 institutions. One of the 24 men received a 
rating of Excellent, six a rating of Very Good, eight a rating of 
Good, two a rating of Fair, and the remaining seven failed, 
receiving a rating of Unsatisfactory. Five of the men who 
made a rating of Good or better were given the two-week trial 
assignment and completed the assignment with the following 
ratings: Good, Good, Good, Very Good, and Excellent, re- 
spectively. 

Thirteen trainees in 10 institutions qualified for the Teacher 
Performance Test, which has been given to six of these men. 
They received ratings of Good, Good, Good, Very Good, Very 
Good, and Very Good, respectively. Three of these six served 
as full-time teachers in their institutions for a two-week trial, 
performing during this trial period the duties of one who teaches 
inmate classes. For the trial period one of the three received a 
rating of Good, and the other two a rating of Very Good, re- 
spectively. 

The performance test for Auto Mechanic was given to 10 
trainees, a total of 17 in nine institutions having qualified to 
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take it. One of the 10 who took the test failed it, one received 
a rating of Good, five a rating of Very Good, and three a rating 
of Excellent. Six of these nine men who received a rating of 
Good or better completed their two-week trial period; two were 
lated Good on the trial period and the other four each, Very 
Good. 

There are several important thing.s to he learned about this 
testing program. No studies have been made of the correlation 
between the number of pensons failing to cpialify to take a 
performance test and success in general custodial work in the 
Federal Prison System. No studies have been made of the cor- 
relation between failing the tests and resignations from federal 
prison work. Additional time will be required to determine 
definitely the reliability of the test items of each test and 
method of rating. 

The flexibility in the method of rating each trainee raking a 
performance test in the series may at the same time be both a 
strength and a weakness of this testing program. Fiom a scien- 
tific point of view this flexibility is a shortcoming as it precludes 
testing that is completely objective. This flexibility, resulting 
from a test score based on a partially controlled personnel 
rating scale method rather than on a precise weighting scale, 
makes possible a disparity in rating. The disparity may be re- 
flected when different people with different ideas concerning 
standards of job performance rate the same trainee on two dif- 
ferent tests, in those few instances where a trainee takes a test 
in each of two occupational fields. It may also be reflected 
when different trainees in different institutions are being rated 
on the same test. 


Unique Features of the T ests 

Each of the 35 tests in the series calls for an actual demon- 
stration and application of specialized knowledge. Whether 
claiming trade or professional training and experience the per- 
son taking a test must demonstrate and apply specialized 
knowledge basic to the occupational field in which he claims 
training or experience. In the professional occupations par- 
ticularly this requirement represents in large measure a novel 
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approach to testing since access to professional fields is usually 
gained through the completion of courses in accredited schools 
or through the passing of state written examinations rather 
than as the result of a demonstration of ability to meet specific 
standards of performance. 

For the professional occupations included in the group of 
35 prison-related occupations it was more difficult to develop 
this perfoimance test approach than it was for the trades and 
the other non-professiortal occupations. 

The tests were validated against a broad rating scale based 
on the quality of performance of jobs that men in the specific 
occupations are expected to be capable of handling. In meas- 
uring an employee’s training and experience, or rather the re- 
sults of such training and experience, such vital matters as the 
way he goes about performing typical jobs and his speed as 
lelated to the regular production rate of a qualified person in 
the occupation, are taken into consideration. 

In this series a newly devised standard test for use through- 
out an organization is combined with the Federal Government’s 
standard rating system. This makes it possible for supervisory 
personnel who are not test experts but who are specialists in 
various occupations to administer the tests, as they are already 
familiar with both the subject matter of the test and the method 
of rating. At the same time the use of this type of test makes 
it possible to give supervisory personnel a large part in the 
initial selection of employees for their own departments and 
hence provides an incentive for them to do a thorough testing 

job. 




PREDICTING SUCCESS IN INTRODUCTORY 
PSYCHOLOGY 

LILLIAN G PORTENIER 

University of Wyoming 

Predicting success in various courses is a perennial prob- 
lem of all effective advisors of university students. While 
essential in all fields, such prediction is particularly desirable 
in Introductory Psychology, since one of the major objectives 
of the first course in Psychology m most departments is to 
make it “useful to the individual student by developing his 
ability to understand and to cope witb the personal adjustment 
problems of daily life” (8). 

The present study includes data on 1,035 students enrolled 
in the introductory course in Psychology at the University of 
Wyoming for the three years, 1944-1947. During the last two 
years of this period the testing program for freshmen and 
other new students at the University was expanded to include 
a battery of tests. Since 1929 the Ohio State University Psy- 
chological Test has been administered to all high-school seniors 
m Wyoming by the Personnel Department of the University 
and, immediately following their enrollment, to incoming 
students for whom scores were not on file from the high -school 
testing program. In addition to the O.S.U. Test, the enlarged 
battery includes the American Council of Education Test, the 
Nelson^Denny Reading Test, the Iowa High School Content 
Examination, The Wrenn Study Habits Inventory and the 
Cleeton, Kuder and/or Strong Interest Inventory, 

During the school year 1944-1945, in which results on the 
O.S.U. TesU only were available, the correlation between scores 
on this test and the grades earned in the first quarter’s work 

^Form 21 of the O.SU Test was used for all scores throughout the present 
study. 
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in Psychology for 173 students' was found to he .667 -h .026. 
This is a higher correlation than has been found in most studies 
for college grades and various prognostic measures. In 1931 
Harl R. Douglass (1) found the computed median for over 250 
such coirclations on various tests to be .45. L. B. Kinney (3) 
compiled another summary of prediction studies in 1932. Pie 
found a median correlation of .445 between college grades and 
intelligence test scores. This figure is almost identical with 
that found by Douglass. Another compilation of .studies with 
similar results was made by David Regel (5) in 1934 working 
under the U. S. Office of Education. Pie found a median cor- 
relation of .44 between 100 studies on college marks and scores 
on intelligence tests. Wagner (7) .summarized the median 
correlations between college grades and several specific tests of 
mental ability. PIci coirclations for the O.S.U. test range from 
.43 to .50 and from .17 to .81 with a median between .40 and 
.50 for the American Council test. Her figures also arc veiy 
similar to the findings in the eailier studies cited above. 

A significantly higher median correlation of .50 or above 
has been found in summancs of studies made dining the past 
decade. Durflingcr (2) .states that the higher con elation may 
be a result of the newer te.sts of intelligence measuring “more of 
the factors present in scholastic giades than did the earlier 
ones, or of college instructors using intelligence test results to 
assist them in arriving at the grades awai deii students.” How- 
ever, intelligence tests vaiy widely not only among them- 
selves in their ability to predict college grades but any given 
test may also show wide variations in its ability to predict 
success in different departments or schools. 

Although the correlation of .667 zh .026 between O.S.U. 
test scores and class marks in the first quarter’s woik in psy- 
chology at Wyoming for 194^4-1945 was much higher than that 
found in most studies, the equation of regression indicated that 
the 0,S.U. score alone is not a reliable basis for prediction of 
success in individual cases. Consequently, the study was con- 
tinued the following year using the scores on the new tests in 
the battery in addition to the O.S.U. scores. 

The correlation between grades earned in the first-quarter 
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course in Introductory Psychology and the various tests and 
some subtests for 211 students for the year 1945-1946 are 
shown in Table 1.^ The highest correlation, .672 db .025, was 
found for grades earned and scores on the O.S U. Test, and a 
correlation of .616 ± .032 for grades earned and scores on the 
Nelson-Denny Reading T est. The two tests, Ohio and Nelson- 
Denny, appear to measure similai abilities as indicated by a 
correlation of .762 ± .020 between the scores on the two tests 
(Table 2). 

The correlations (.587 ± .031 and .586 ± .032, respectively) 
between grades earned and scores for each of two subtests of 
the O.S.U. Test (Analogies and Reading) while almost identi- 
cal are significantly lower than for the scores on the total test 
(.672 ±.025). 

The scores on the Nelson-Denny Reading Test and the 
Iowa High School Content Test also show a high correlation, 
.742 ± .026 (Table 2), which again seems to indicate a sig- 
nificant overlapping of the abilities measured by the two tests. 
However, the correlation beween grades earned and scores on 
the Iowa Test, .487 ± .045, is much lower than that found for 
the Nelson-Denny Test, .616 ± .032. All correlations with the 
Wrenn Inventory were low. 

The American Council Test appears to be definitely inferior 
to the O.S.U. Test for predicting success in Introductory Psy- 
chology as shown by a correlation of .471 ± .048 for scores on 
the entire test as compared with a correlation of .672 ± .025 for 
the O.S.U. Test, a difference of .20. The correlation for scores 
on the subtest for linguistic ability of the A.C.E. Test is slightly 
higher than for the total test, .501 ± .047 and .471 ± .048, re- 
spectively (Table 1). The A.C.E. Test also shows a high 
correlation with the Iowa and Nelson-Denny tests. 

Significant intercorrelations were found beween the scores 
on all four tests, i.c., O.S.U., Iowa, Nelson-Denny, and A.C.E. 
(Table 2). Since the regression equations indicated that the 
correlations beween the grades and scores on no one of the tests 
or subtests were sufficiently high for any satisfactory degree of 

2 The writer is indebted to Miss Vivian Rose Anderson, research assistant, for 
her aid in compiling these data and for most of the statistical work 
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Correlation! Brlo-rcn Bint Quarter Grader in Inltndticfury I'jyelmlnf’y, ptdl and 
Winter, 19‘J5-P>‘l0, for 211 Sltiilnilr, and Scorer on the Vartour Test! Luted 


Test 

Ohio State University I’hVtIniltifjcal Test 

Suhtest — AnaldKies, OS.U. . 

Suhtest — lieadiiit;, 0 S,U 

American Cimni. il rif Kiliir.ition Test . . . 

Siiliiest — Lmmnstic, A CMC 

Nelhon-Deniiy RcatlinR Test 

Iowa Iliith School Content Test 

Wrenn Sttuly Habits Inventory 


N firades in P.syi liolouy 

211 .(,72.1 112s 

211 .SK7t0U 
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lf,S 471 + (I4S 

IdS 11)1 ■< .1)17 

I'M .r.lfH .(H2 

17H 4H7.l(I45 
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reliability for predicting the success of individual students, 
multiple correlations were computed as shown in 'fable 3 . The 
correlation between grades and scoics on the O.S.IJ., Nclson- 
Denny, and Iowa tests, .682 J- .0212, is no higher than when the 
scores on only the first two tests arc used as variables. The 

TABI.K 2 

Correlations Between Scores on Tens Lined for 211 Students Enrolled for Intro- 
ductory 1‘syUiolniiy, Fall and Wtnler, Fhl’l~l<l4(> 


lost O S U. Iowa 11. S. Content Nchon-Dcnny 


O'S'U', • 6<ir>:t.()13 .7621.020 

Iowa H S, Content 0S6 ± .03 1 742 t ,026 

Nelson-Denny 762 ±.020 .742 + .026 ,..,7 

American Council 724 ±.030 .721) ±.031 ,770±.()2S 


multiple correlations for two and also for three variables are 
only .01 of a point higher than for the O.S.U. Test alone, 
(.682 ± ,030 and .672 ±: .025). The regression equations de* 
rived from these multiple correlations were also unsatisfactory 
for individual prediction. 

Since the O.S.U. Test gave evidence of being the best single 


TABLE 3 


Multiple 

Fall 


Correlations Between First Quarter Grader in Introductory Psychology, 
and Winter, 1945-1946, and Scores on the Groups of Tests JAsted 


Groups of Tests 

O.S.U., and Nelson-Denny 

OSU., Nelson-Denny, and Iowa High School 
Content 


N Grades in Psychology 
194 ,682 + .030 

1S3 .682 + 029 
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test in the battery for prediction of success, and almost as satis- 
factory as any two or three tests in the battery, the results 
weie converted into standard scores and analyzed on the basis 
of the grades earned. The results are compiled m Table 4 
Seventy-five pei cent of all students with scores on the O.S U. 
Test at least two standard deviations above the mean (-1-2 
S.D.) earned grades of I in their first quarter’s work in Psy- 
chology, 16 7 per cent earned grades of II, and the remaining 
8 3 per cent, grades of III. For students with O.S.U. scores 
only -pis S.D., or above, the percentage of I’s earned dropped 
to 68, and the percentage of IPs and Ill’s increased to 20 and 

TABLE 4 

Qvarler Grades in Relation to Slandaid Scores on the 0 S.U Test 
far 213 Students, Fall and Wuiter, 1943-1946 


O.SU. Test 
Standard Scores 


+ 2 SD (Above 122) 

+ 15 SD (Above 110) , . . 

+ 1 S.D. (Above 98) 

+ 0 5 S D (Above 87) 

-05 SD (Below 65) 

-1 S D (Below S3) . . 

-IS SD (Below 41) 

-2 S.D (Below 30) .. . . . 

- 1 S D to + 1 S D (S3 to 93 Inc ) . . . 
-05 SD to I- 0 5 S.D. (65 to 87 Inc.) 


Quarter Grades (Percentage) 


I 

II 

III 

IV 

F 

75.0 

16 7 

83 



68 0 

20 0 

12 0 

, 

, , 

.. 48 9 

26 7 

24,4 



35 9 

35 9 

26.6 

16 



10,6 

541 

212 

141 


6,5 

43 5 

28,3 

213 

. . 


36 8 

27.4 

36 8 



33 3 

50 0 

16 7 

!! 2 5 

31’ 1 

55 7 

98 

08 

33 

32,8 

574 

6 6 



12 per cent, respectively. While the percentage of I’s dropped 
to 48.9 for students with 0 S U. scores of only + 1 S.D. or 
more above the mean, and the percentage of IPs and Ill’s in- 
creased accordingly (26 7 and 24.4 per cent respectively) none 
of these students earned grades below III. From these data 
it would seem safe to predict that students with scores of at 
least -P 1 S.D., or even -P 0.5 S.D., on the O.S.U. Test should 
earn grades of III or above in their first quarter’s work in 
Psychology. With O-S.U. scores at least p- 1.5 S.D., two-thirds 
of the students earned grades of I, and three-fourths earned 
grades of I if their O.S.U. scores were at least -p 2 S.D. 

The above conclusions seem to be verified in general for the 
grades earned by students enrolled in Introductory Psychology 
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for the Fall and Winter Quarters, 1946-1947, as shown by 
Table 5. The enrollment was moie than double that of 194S- 
1946 and the students weie taught in classes almost twice as 
large, i.e., in gioups of 75 to 100, rather than 40 to 50. Since 
a majority of the students weie veteran.s, competition was very 
keen and the instructois did not have adequate time for indi- 
vidual attention and guidance. 'I'heir grading also may have 
been somewhat more stiict as evidenced by a marked reduction 
in the percentage of I’s. No pronounced change was evident in 
the peiccntage of Ill’s, IV’s and F’s. Replacing the basic text 

TABLE 5 

Quarter Grades in Relation to Standard Stores on the OS.U. Test 
for 4d5 Students, Fall and Winter, I'UO-FHT 


O.SU Test 


Quarter G 

ntdes (I’errcntano) 

Standard Scores 

I 

ir 

III 

IV 

F 

+ 2 S.D (Above 122) 

.. .5(10 

43.8 

6 3 



+ 1,S SD (Above 110) 

.. 38 1 

42 6 

19 1 

, , 

A * t 

+ 1 S.D. (Above 9K) 

. . 29.8 

42.9 

25.0 

2.4 

. . . 

+ 0.5 S.D, (Above H7) 

. . 20.3 

37 6 

37,6 

4,5 

, , 

-O.S SD (Below 65) 

.. 19 

15,7 

41 0 

28 9 

12 7 

~1 S.D, (Below 53) 

. . 0.9 

8.8 

39.8 

32 0 

18,4 

-1,5 S.D (Below 41) 

. » « « 

10 5 

41.7 

20 8 

27,1 

-2 S.D, (Below 30) 

• * ♦ • • 

14.3 

50,0 

14.3 

21.4 

- 1 S D. to + 1 S.D. (53 to 98 Ino.) . . . . 

.. 6.1 

25.6 

53,3 

13 4 

1 6 

-O.S SD. to + nS S.D. (65 to 89 Inc.).. 

. 9.0 

24.6 

55,2 

9.7 

1,5 


used in the course from Dockeray, Psychology, third edition, 
used in 1945-1946, to Munn, Psychology, in 1946-1947, may 
have increased the difficulty of the couise for some students. 
However, the curves of distribution for giades earned by the 
students enrolled for the course weie veiy similar for the two 
years. Both curves were fairly noimal. The percentage of 
IV’s and F’s was somewhat less than the percentage of I’s and 
TI’s resulting in a slight negative skewness of the curves. 

Most of the students with negative O.S.U. standard scores 
earning grades above III, i.e., above average, were veteians 
who were more mature and far more strongly motivated toward 
success than the regular undeiclassmcn, a majority of whom 
were freshmen or sophomores. Case studies were made of all 
students with negative O.S U. scores earning grades above 
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average, and also of all students with positive O.S.U. scores ' 
with grades below average. With very few exceptions the 
discrepancy for the first group of students, i.e., those with 
negative O.S.U. scores but grades above average appear to be 
the result of inaccurate O.S U. scores. The test was adminis- 
tered to most of these students as high-school seniors in the 
local high schools. In some cases the students were not en- 
couraged to put forth their best efforts and/or inadequate 
emphasis was placed on the importance of the results as one 
basis for counseling and guidance. High scores for Psychology 
on one or more of the interest tests also were indicative of 

TABLE 6 

First Quarter Grades in Relation to Standard Scores on the A C.E. Test 
for 400 Students, Fall and Winter, 194S-1947 


American Council of Education gtrarter Grades (Percentage) 


Standard Scores 

I 

II 

III 

IV 

F 

+ 2 SD (Above 148) 

33 3 

46 7 

200 



+ 15 SD (Above 137) ., 

. 290 

38 7 

32 3 


, 

+ 1 S.D (Above 126) . 

246 

42 0 

319 

15 


+ 0.5 SD. (Above 115) 

. 170 

35 4 

415 

48 

1,4 

-0.5 SD (Below 95) 

. 18 

4,6 

47.7 

27.5 

18 3 

-1 SD. (Below 84) 


1.7 

414 

29 3 

276 

15 SD (Below 73) 

• . . 


42.9 

179 

39.3 

-2 SD (Below 62) 

. . 


27 3 

18 2 

54.5 

- 1 S.D. to + 1 S D (84 to 126 Inc.) 

48 

19 3 

55,6 

16 7 

37 

-05 SD to +0,5 S.D, (95 to IIS Inc) 

2.1 

18.3 

58 5 

18 3 

28 


superior achievement for these students. In other cases the 
discrepancy may be attributed to the greater maturity and 
experience of the students after their period of service and 
perhaps also to greater familiarity with tests, which resulted 
in materially higher scores on the tests taken after enrolling at 
the University, viz., on the A.C.E , Nelson-Denny, a repetition 
of the O.S.U., et cetera. Nevertheless, the A.C.E. scores con- 
verted into standard scores and analyzed on the basis of the 
grade earned were found to be less useful for prediction than 
the O.S.U. scores as shown by the data in Table 6. The find- 
ings are not as clear cut and consistent. There is very little 
difference beween the groups with A.C.E. scores of -p 1 S.D. 
and above and those with scores of T- 1 5 S.D. and above in the 
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percentage of students earning grades of I and 11 (Table 6). 
Likewise as many students in the group with A.C E. scoies of 
— 1 S.D. and below were given IV’s and b'*s as in the group 
with scoics of —• 1.5 S.l). and below. 'The inferiority of the 
A.C.K. scores to the O.S.U. .scoies a.s a ba.sis for predicting 
success in Introducioiy Psychology was indicated al.so by the 
lower correlation vvith giades as shown in Table 1 above, 
.471 ± .048 vs. .672 :t- ,025, lespectively. 

The figures in 'fiablc 7 suggest that the O.S.U. scores may be 
equally useful for predicting .succe.ss in the second quaiter'.s 
work in Introductory P.sychoIogy, Although the data are 

TAHLE 7 

Second Quarter Gritdes in. Relation, to Slanilard Store! mi the O.S U. Teil 
jar 176 Students, Winter Quarter, rj-t<)-Vf47 


OS.U Tot; 
Standanl .Scores 


+ 2 .SD, (Above 122) 

SD, (Above 110) 

+ 1 S D. (Above 98) 

+ 0,S SD. (Above 87) 

-OS SD (BcU)w 6S) 

-1 SD. (Below S3) 

-l.S S.D. (Below 41) 

-2 S D. (Below 30) 

-1 S.D, to H SD. (53 to 98 Inc.) .. 
-OS S.D to -l-O.S S.D, (65 lo 87 Inc) .. 


Quarter drader (I’lTCentapo) 


I 

ir 

III 

IV 

r 

•lU 

,1.3,3 

22 2 



20 8 

54 2 

20.8 

4 i 

, , 

2.5,5 

38.3 

29 K 

6.4 

, 

19 2 

32 9 

42 5 

4.1 

1,4 

1 • » 

2 0 

58 0 

28 0 

12,0 


. . . 

42,1 

34 6 

23 1 


^ , 

40,1) 

20.1) 

40 0 


1 1 » 

50.0 

. • 

50.0 

5.8 

20 4 

57.3 

10 7 

5 8 

7,7 

25,0 

4(,2 

11.5 

96 


based on a similar number of students with a narrower range 
of O.S.U. scores, the poorer students having been eliminated 
through failure, the distribution of grades earned i.s veiy similar 
to those for the first quarter’s work. 

From these data it would seem that the critical O.S.U. score 
for success in either the first or second quarter’s work m In- 
troductory Psychology appears to be about 87 when success 
is defined as a grade of III or better. The chances for earning 
grades of I or II, however, are materially increased by raising 
the critical score to 98 or above. Such critical scores arc not 
only simpler to apply but are also far more practical as a basis 
for prediction than the regression equations derived from the 
correlation between grades and test scores suggested earlier. 
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While the critical scores on the O.S.U. Test in the present 
study are for Form 21 only, and were determined solely from 
data on students enrolled in Introductory Psychology as offered 
at the University of Wyoming during the two-year period 
1945-1947, they may be quite geneially applicable. A score 
of 87 is listed as having a percentile rank of 62 on the Ohio Col- 
lege Association norms as compiled by Toops (6) for 3889 col- 
lege freshmen on Form 21, a score of 98 as a percentile rank 
of 72. Toops has found a minimum score of 94 for Phi Beta 
Kappa students at Ohio State University. FIis studies indicate 
that most students with scores of 94 or better on Form 21 will 
do superior university work if properly motivated. This find- 
ing has been verified lepcatedly in studies (4) made at the 
University of Wyoming not only for Psychology but also for 
courses offeied in most other depaitments. 

The present study then contributes to the eaiher findings 
primarily in determining more specific critical scores for pre- 
dicting various levels of success in Introductoiy Psychology as 
taught at the University of Wyoming. The scores were de- 
rived from data on over one thousand students enrolled in 
Introductory Psychology over a three-year period. Sections 
of the course were taught by several different instructors vary- 
ing widely in their rriethod of presentation. Consequently, the 
critical scores which appear to have a reasonable degree of 
reliability and validity for use in counseling students may be 
quite generally used for predicting success in Introductory 
Psychology, and they may apply to other fields of study as 
well. 
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IMPLICATIONS OF A BRIEF STUDY OF PREDICTION 
OF SUCCESS IN THE MEDICAL SCHOOL, MEDI- 
CAL COLLEGE OF VIRGINIA^ 

A W. HURD 
Medical College of Virginia 

Benjamin Fine in his recently published book, Admission 
to American Colleges (4), based on questionnaiie returns from 
450 American colleges, says that 28 per cent of the colleges use 
no tests for admission, and that over half make almost no use 
of admission tests, although 90 per cent say that they use them 
foi guidance and placement. However, many colleges have 
been using admission tests for several years. The movement 
is largely an aftermath of World War I. The Moss Medical 
Aptitude Test has been popular in medical schools although 
there is now a new committee in this field experimenting with 
other medical aptitude tests. Crawford and Burnham in their 
new book, Forecasting College Achievement (1), point out 
that there is a need for locally-prepared aptitude tests: “The 
very fact that numerous .... universities have constructed 
their own general intelligence or aptitude tests indicates a rec- 
ognized need for special, localized evaluations.” They add: 
“To be meaningful, reliability and validity should, whenever 
possible, be determined locally and anew .... rather than by 
mere inference from previously obtained data.” 

It has been quite conclusively demonstrated that no tests 
yet devised predict success in college work very reliably. 
There are, of course, many factors influencing such success and 
it is, therefore, not surprising that more accurate prediction 
has not been achieved. In one of our numerous studies at the 
Medical College, we found that, in one class in the School 

1 Given before the Psychology Section, Virginia Academy of Science, May 9, 
1947 
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of Nursing, a group of students who had dropped out did not 
differ significantly, in average IQ (Otis Higher Examination)^ 
or in American Council Psychological percentiles, from those 
who remained, and wo listed 27 possible reasons for the failure 
of students with inherent ability. 

It is becoming clearer that one leason for unreliable pre- 
diction resides in invalid and unreliable grades given by in- 
structors. We cannot hope for valid and reliable prediction 
when the thing we arc predicting is, itself, unreliable, invalid, 
or illy defined. Until we can have reliable and valid measures 
of achievement, therefoi'c, we cannot have reliable and valid 
prediction. One of our own studie.s reporred in the Journal of 
Educational Research (5) suggests how this concept works out. 
When a comprehensive achievement test in Basic Science for 
Nurses (260 items requiring two hours of work — reliability co- 
efficient .94 ±.01) was used to measuie achievement at the 
end of the prcclinical perrod, the con elation between student 
ranks on this test and the average ranks in four entrance ex- 
aminations: American Council PsvcJinh^s^tcal Examination, 
Otis Test of Mental Ability — Higher Exami>iation, a local 
test, Exercises in Reading Medical Literature, and a local test 
in Arithmetic was .90 ± .02. (Spearman rank-difference 
method used for 29 students in nursing.) This is the highest 
predictive coefficient I have seen reported in educational 
literature. It is based on only a few cases but is reported for 
what it may be worth. A correlation of this magnitude cer- 
tainly points to the need of further investigation. It gives 
evidence that with better achievement measures of an ob- 
jective nature, we may hope for better prediction. Probably 
much of the unrehability in prediction reported in so many 
studies is due to poor and uncertain measures of achievement. 

This paper presents four coii'clation coefficients computed 
for one of our classes in medicine. The coefficient between 
average grades in three years in the Medical School and per- 
centiles in the Moss Medical Aptitude Test for 67 students was 
found to be .14 ± .08 (Otis Chart). That between the grades 
and a local test in reading medical literature—Comprehension 
— was .04 ± .09. That between the grades in the Medical 
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School and the grades received in high school was .28 ± .08. 
That between the Aptitude Test and the Reading Test was 
.47 ± .08. There IS apparently no reliable prediction from 
any of the tests used as entrance tests. Even high-school 
grades are not significant The two tests — Aptitude and 
Reading — show a higher relationship. These data taken to- 
gether suggest a reason for the poor prediction of average 
grades obtained — abilities recognized in grades given are not 
the same as abilities represented in the entrance tests. The 
former undoubtedly are based, partially at least, on social and 
personality characteiistics not represented in the latter. And 
there are certainly abilities lepresented in the entrance tests 
not identified in the grades. Correlations obtained by many 
investigators are pointing to the conclusion that various of 
the so-called “new-type” objective tests measure different 
functions in themselves. True-false, multiple-choice, match- 
ing, analogies tests, and the like involve some specific abilities 
differing from one another. We have some substantiating 
data for this statement. For example, a true-false test in 
cliemistry gave a correlation coefficient of .23 ± .10 with a con- 
trolled completion test in the same area. It seems logical that 
predicting tests should be of the same sort and test the same 
abilities as the abilities identified and recognized in the grades 
given. To predict success in any field — logical reasoning, 
medicine, surgery, nursing, pharmacy, the pretests for pre- 
diction must be closely related in type and abilities sampled to 
the achievement tests upon which the final grades are based! 
This implies that achievement ratings which are the mere per- 
sonal judgments of instructors must be replaced by objective 
ratings of the sort used as pretests if accurate prediction is to 
be expected. And pretests should desirably sample the abili- 
ties which are identified and recognized in instruction — not 
merely general scholastic oi general intelligence tests. 

Better measures of achievement can only be secured by 
making sure that we have clear aims and objectives in instruc- 
tion, with all courses planned to efficiently accomplish these 
objectives in student performance. So far, our * objectives 
have been too vague and indefinite. Often they are not even 
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given statement, and then, too often, are expressed for effect 
in inducing students to attend a particular institution, oi to en- 
roll for particular courses. And we cannot overlook the point 
made by Davis in his article in the Journal of Educational 
Psychology (2): “Although potential abilities lank high 
among the list of factors indicative of potential success, the 
individual’s active inteiests constitute the diiving force In his 
achievement.” 

The movement to identify and to evaluate factors of a 
comprehensive nature possessed by individuals, like those listed 
by Holzingei, Thurstonc, the Yale Battery, and so on, are un- 
doubtedly valuable for ceitain purposes but they have not yet 
airived at a common denominator and arc peihaps too compre- 
hensive and not specific enough for the kind of prediction we 
seek. As quoted by Crawford and Burnham (1), “On this 
subject, Godfiey Thomson — offers the follov\dng comment: 
‘The different .systems of factois proposed by diffeicnt .schools 
of factorists have each their own advantages and disadvantages, 
and It is leally impo.ssible to decide between them without 
first deciding why we want to make factoiial analyses at all.’ ” 

At present, I lean toward the plan of (1) developing insti- 
tutional and couise aims and objectives; (2) pointing instruc- 
tion toward efficient specific accomplishment of ultimate and 
immediate objectives; (3) and evaluating preliminary and 
final student status toward achievement of the abilities repre- 
sented in the specific purposes in mind. Then we may look 
fomard to purposeful planning, puiposeful instiuction, and 
purposeful prediction. As quoted from Tyler in a recent 
American Council on Education study (6) : “Logically, then, 
the first step in laying the foundation of a broad program of 
individual evaluation is to foimulate a statement of the funda- 
mental puiposes for which the school exists.” 

We have gone forward on this basis in the continuing de- 
velopment of a basic curriculum for nurses (3), and are be- 
ginning on a similar basis in the Medical School. 
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NEW TESTS* 

Army General Classification Test, Civilian Edition, 1947. Three 
types of test problems are included: vocabulary, arithmetic word 
problems, and block counting. For high-school, college, and 
adult groups. Time limit" 40 minutes. Reusable test book- 
lets with answer pad, 45^, package of 25 answer pads, ^1 65, 
specimen tests (self-scored), 75 (J; test booklets (machine- 
scored), 35^, answer sheets (machine-scored) package of 100, 
$2.35, scoring keys (machine-scored), SOtji. Published by Sci- 
ence Research Associates. 


Arthur Point Scale of Performance Tests, Revised Form 11, by 
Grace Arthur, 1947. A five-pait non-verbal test. Standard- 
ized on children 5-15 years old, extrapolated norips above 15 
years. Knox Cube Test (Arthur Revision), $2.50; Seguin Form 
Board (Arthur Revision), $15.00; Arthur Stencil Design Test I, 
$3 00; Porteus Maze Test (Arthur printing), fourteen mazes 
each in pads of 100 copies, 1-9 pads, 70(il; Healy Picture Comple- 
tion Test II, $20.50; Manual, $2 25; Score sheet pads of 100, 
$2.50; package of 100 score cards, $2 50. Complete set, includ- 
ing all tests, 100 score sheets and manual, $49 00 Published by 
The Psychological Corporation 


Bennett Use of Libiary Test, 1947, by Alma Bennett and H. E. 
Schrammel. This is an achievement test intended to measure 
knowledge of library organization and practice. Range: High- 
school and college students. Working time" 50 minutes. Pub- 
lished by Bureau of Educational Measurements. 


Cooperative Achievement Tests, 1947, Form X. Test booklets per 
package of 25 are piiced as follows: Group A, $1.75; Group B, 
$2.00; Group C, $3 00; Group D, $3.75. Answer sheets per 
package of 25" special one-sided, 40^, special two-sided, 60^1; 
standard one-sided, 40^!; standard two-sided, S0<js. Stencil, 15^( 
and 30^ (for one and two-sided answer sheets, respectively). 
Hand-scoring key, manual and norms supplied with each order. 
Published hy Cooperative Test Service of the American Council 
on Education. 

* The addresses of the publishers of the tests listed are given at the end of the 
section. The prices given ate for the smallest package listed by the publishers. 
Lower rates for larger quantities are often available; information on this point may 
be obtained from the publishes. In some instances, certain details are not included 
because they were not available at the time of going to press. 
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American Government Tert (Reviu'd Series), by John Haefner. 
Graphic and veibal matciial for the purpose of measurinf; under- 
standing of concepts developed in couises'. Working time; 40 
minutes-. Range: High-school cla.s.ses. Gioup A booklets. 
Special one-sided answer .sheets. 

American History Test {Revised Series), by ILiriy D Berg and 
H. R. Andeison. Designed for measuiement of uiuleistanding 
and information of matcuals presented in secondary-school or 
elementaiy-collegc courses in American hi.stoiy. Working time; 
40 minute,s. Range; High-school and elementaiy-college classes 
in American histoiy. Group A booklet; special onc-suled an- 
swer sheets. 

Biochemistry Test, by The Cooperative Test Seivice and the 
American Chemical Society. Part I planned to measure funda- 
mentals of biological chemistry usually given first semester; 
Pait IIj second semester achievement test of a year in Physio- 
logical Chemistry. Range; College and medical-school classes 
in biological chemistry. Woiking tune: .SO minutes for each 
part. Group B booklet; standard one-sided answer sheets. 

Biology Test, by Paul E. Kambly, ct al. Intended to primarily 
investigate student’s factual knowledge. Working lime; 40 
minutes. Range: Iligh-school classes in biology. Gioup B 
Booklet; special onc-sided answer sheets. 

Chemistry Test, by Paul J, Burke and Theodore A. A.shford. 
Planned to test fundamental facts and principles. Range: 
High-school classes in chemistry. Woiking time: 40 minutes 
Gioup A booklet; special onc-sidcd answer sheets. 

Chemistry Test in Quantitative Analysis, by Cooperative Test 
Service and the American Chemical Society. Covers “theo- 
retical principles . . in volumetric or gravimetric procedures 
in an elementary course . . .” Working time: 110 minutes. 
Range: college courses in Quantitative Analysis. Group A 
booklets; standard one-sided answer sheets. 

Commercial Arithmetic, by The Staff of the Coopei alive Test 
Service. Norms available for one and two semesters. Working 
time; 40 minutes. Range: lligh-school classes in commercial 
arithmetic. Group A booklet; standard onc-sided answer sheet. 

Contemporary Affairs for College Students, Form 1947, by E. F. 
Lindquist, Robert L. Ebel, Goldwin Smith, and Wendell Smith, 
et al Three parts: Public Affairs, Science and Medicine, Lit- 
erature and Fine Arts. Working time: SO minutes. Range: 
College classes. Group B booklet; special one-sided answer 
sheets. 
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Effectiveness of Expression {Higher Level), by Miriam M. 
Bryan and Geraldine Spaulding Areas of English investigated 
by this test include sentence structure and style, diction, and 
organization. Range Superior 11th- and 12th-grade students 
and college students. Working time 40 minutes. Group A 
booklet, special one-sided answer sheets. 

Effectiveness of Expression {Lower Level), by Miriam M. 
Bryan and Geraldine Spaulding. Questions bearing on style, 
diction and organization of English are included in this test. 
Range Grades 7 to 12. Woiking time: 40 minutes. Group A 
booklet, special one-sided answer sheets. 

Foods and Nutrition, by Cooperative Test Service and the 
Evaluation Committee of the American Home Economics Asso- 
ciation. A test which is designed to measure pre-professional 
information, knowledge of methods and opeiations in areas 
relating to home economics and nutrition. Working time. 90 
minutes. Range. Pre-professional college classes. Group B 
booklet, standard two-sided answer sheets. 

French Test {Higher Level), by Geraldine Spaulding, Laura 
Towne, Sarah Wolfson Loige, et al. Consists of three parts. 
Comprehension, Grammar, Civilization. Range: Students' with 
more than two years high-school French, or more than one year 
college. Working tune: 80 minutes. Group B booklet; special 
two-sided answer sheet. 

French Test {Lower Level), by Geraldine Spaulding, Laura 
Towne, Sarah Wolfson Lorge, et al. Includes sub-tests on Com- 
prehension, Giammar, and Civilization. Range; Students in 
first two years of high-school or first-year college French Work- 
ing time" 40 minutes. Group A booklet, special one-sided an- 
swer sheet. 

General Proficiency Tests, Revised Series: 

Mathematics, by Paul J. Burke, Rose E. Lutz, and L. P. 
Siceloff. 

Natural Sciences, by Paul J, Buike, Paul E Kambly, and 
V. FI. Noll. 

Social Studies, by Jeanne M. Bradford, et al 
Three sepaiate tests. Each test consists of 2 parts: Terms and 
Concepts, and Compichension and Interpretation, Range: 
Grades 10 through 12 and entering college freshmen. Time: 40 
minutes (each test). Booklets are all Group B, special one- 
sided answer sheets. 

General Culture Test {Revised Series), by Norman J Blair, 
Jeanne M. Bradford, Miriam M. Bryan, Paul J. Burke, Herbert 



136 EDUCATIONAL AND PSYCHOLOGICAL MEASUREMENT 


Danzei, et al. Purpose is to secure an indication of cultural 
back/'round. Six 30-minute sections comprise the test; Current 
Social Prolilcms, History and Social Studies, Literature, Science, 
Fine Alts and Mathematics. Ran};e: College .students. Work- 
ing time: 30 minutes (each section). Group D booklet, answer 
sheets for 25 tests, Jil.OO 

General Science Test (Revised Series), by Paul K. Kambly and 
Paul J. Burke. Information and iiiuiei .standing are under.stood 
to be tested. Range: High-schoot classes in gcncial science. 
Working time; 40 minutes. Gioup A booklet, special one-sided 
answer sheets. 

Italian Test (Revised Series), by Peter Riccio, Anthony Cuffari, 
et. al. Reading, Vocabulary and Giammar are the three sections 
of this test. Range- Students with two oi more semesters of 
study of Italian. Working time; 40 minute.s'. Group A book- 
let, special one-sided answer sheets. 

Mathematics Test for Giades 7, S, 9, bji Vernon Price, ct al. 
Foul paits labeled Skills; Facts; Terms and Concepts; Applica- 
tions; and Appreciation are included. Range- Guides 7, 8, 9. 
Working time. 80 minutes. Group B booklet, special onc-sided 
answer sheets. 

Mathematics Pre-Test for Gollcfte Students, by The Committee 
On Test.s Of The Mathematical As.sociation Of Ameiica, ct al. 
Intended to offer a sampling of high-school mathematics abili- 
ties. Range: Pre-test for beginning college matbeniaiic.s courses. 
Working time: 40 minutes. Group A booklet, standard onc- 
sided answer .sheets. 

Mechanics of Expression, by Geraldine Spaulding and Herbert 
Danzer. An English test designed to cover usage, punctuation, 
capitalization and spelling. Range; Grades 7 through 12 and 
college classes Working time: 40 minutes. Group A booklet, 
special one-sided answer sheets. 

Modern European History Test (Revised Series), by Frederick 
H. Stutz, et al. Questions call foi information and understand- 
ing of material from beginning of Renaissance to the present. 
Range; liigh-school and elementary-college clas-sCvS in Modern 
European History. Working time; 40 minutes. Group A book- 
let, special one-sided answer sheets. 

Physics Test (Revised Series), by Paul J. Burke. Achievement 
in a secondary-school physics course is expected to be indicated 
by this test. Range: High-school classes in physics. Working 
time. 40 minutes. Group A booklet, special one-sided answer 
sheets. 
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Science Test jor_ Grades 7, 8, and 9, by Paul Kambly, at al 
Knowledge of principles and functioning of common mechanical 
devices as well as natural phenomena is called for here. Work- 
ing time . 80 minutes. Group B booklet, special one-sided answer 
sheets. 

Social Studies Test jor Giades 7, S, and 9, by Harry D. Berg, 
Elaine Forsyth, et al. Content includes items relating to eco- 
nomic, social, physical and historical factors in the development 
of the American nation. Working time: 80 minutes. Group B 
booklet, special one-sided answer sheets 

World History Test {Revised Senes), by Wallace Taylor, How- 
ard R. Anderson, et al. “This test covers the entire period from 
prehistoric times up through the present. , .” Range: High- 
school classes in World History. Working time 40 minutes. 
Group A booklet, special one-sided answer sheets. 


Diagnostic Reading Tests, by Committee on Diagnostic Reading 
Tests, 1947. This battery has been developed to ascertain read- 
ing skills from Grade VII through first year college. The bat- 
tery consists of five sections. Two equated forms (Form A and 
Foim B) are available. 

The Survey Section, in one booklet, measures (1) the rate of 
reading geneial, easy, story-type material, with a check on com- 
prehension; (2) vocabulary comprehension; (3) comprehension 
of usual textbook-type material. 

Section I, Vocabulary, in one booklet, measures vocabulary 
compiehension. In addition to a general vocabulary score, 
scores may be obtained on the following types of specialized 
vocabulary: English grammar and literature, mathematics, 
science, and social science 

Section II, Comprehension, in two booklets: Part 1, Silent, 
measures reading skills used in the usual work-type school 
assignments, Part 2, Auditory, measures ability to comprehend 
oral presentation of materials 

Section III, Rates of Reading: Part 1, General, measures the 
ability of the student to vary his rate of reading story-type 
material according to instructions given him; Part 2, Social 
Science, measures the student’s usual rate of reading textbook- 
type social science material; Part 3, Science, measures the stu- 
dent’s usual rate of reading textbook-type science material. 

Section IV, Word Attack, in two booklets: Part 1, Oral, in- 
cludes six graded paragraphs which are read aloud by the student 
while the examiner records any errors made while the student 
reads such as mispronunciations, repetitions, substitutions, and 
others. Part 2, Silent, measures the ability to hear sounds of 
vowels and consonants and the ability to divide words into 
syllables. Published by Committee on Diagnostic Reading 
Tests, Inc. Distributed by Educational Records Bureau. 
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Differential Aptitude Tests, liy GeorRC K. Bcrinutt) Harold G. Sea- 
shore, and Alexandei Wesman, 1947. This battery is intended 
for the measuicment of some isolated factni.s of ability'. Appli- 
cable to students in Grades 8 through 12, and young adults. 

Verbal Roa.soniiig — Analogies form of item make up this test 
“aimed at the evaluation of the student’s ability to abstract or 
geneializc, . . Working time: 30 minutes. Per copy, 13^; 
1-3 packages, ?2.7S,* 

Numeiical Ability — Aiithmetic computation is called for in 
this test. Working time: 30 minutes- Per copy, 10(f; 1-3 pack- 
ages, 552.00.* 

Abstract Reasoning — Discernment of pattern in .serial dia- 
grams and generalizing the operating principle is recpiired here. 
Working time; 25 minutes. Per copy, 13 1-3 packages-, }52.7S.* 

Space Relations — Items require “mental manipulation of ob- 
jects in three dimensional space.” Working time: 30 minutes. 
Per copy, 14i;*; 1-3 packages, }!3 00.* 

Mechanical Reasoning — Items similar to those of Bennett 
Mechanical Comprehension Tests, i.e , pictured mechanical situa- 
tions. Working time: 30 minutes. Per copy, lOj*; 1-3 pack- 
ages, 553.50.* 

Clerical Speed and Accuracy — Intended to measure perceptual 
speed, biief retention, and rc.sponsc speed. Working time: 6 
minutes Per copy, 1-3 packages, 552,75.* 

Language Usage: 

Spelling— Adaptable to macliine scoring. Working time: 
10 minutes. 

Sentence, s — Disci imination of incorrect items of grammar, 
punctuation and spelling is required. Working time: 25 min- 
utes. Per copy, 13 (J; 1-3 packages, 552.75.* 

Answer sheets, package of 50, ^1 50; package of 500, $13.00; in- 
dividual report forms, package of 50, 551.25; stencils, purchased 
separately, 25{i per test; one set, $1,25. Manuals of directions 
accompany test. Published by The Psychological Corporation. 


Farnsworth Dichotomous 7'en for Color Blindness, by Dean Farns- 
worth, 1947 An aid in distinguishing the functionally color 
blind and those moderately defective from normal persons, Ma- 
terials include rack, color caps, and scoring sheets. Time: About 
2 minutes per subject. Set of materials, manual, and 100 analy- 
sis sheets, $21.00; packages of 100 analysis .sheets, $2.50; manual 
only, 3S{5. Published by The Psychological Corporation. 


Guilford-Zimmerman Aptitxidc Survey, by J. P. Guilford and Wayne 
S. Zimmerman, 1947. This battery is designed to sample seven 
factorially unique tiaits of ability in the areas of abstract intel- 
ligence, clerical aptitude, and mechanical aptitude. Range: high 


25 Copies per package 
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school, college, and adults Norms are currently available on 
college groups Administration time for all seven parts is three 
hours. Parts of the test may be used m any number or com- 
bination. Answer sheets are available foi all except Parts III 
and IV. Manual, 25^; package of 25, Part I, Verbal Compre- 
hension, Part II, Gencial reasoning. Part III, Numerical Opera- 
tions, Part IV, Perceptual Speed, ?2.00 each; Part V, Spatial 
Orientation, and Part VII, Mechanical Knowledge, are ?3.S0 per 
package of 25; Part VI, Spatial Visualization, $5.00 per package 
of 25; scoring keys for test booklets, $1.00 per part. Stencils 
for answer sheets, SO^ per part. Published by Sheridan Supply 
Company. 


Hams Tests o{ Lateral Dominance, by Albert J tlarris, 1947. Hand, 
eye, and foot dominance are investigated by these tests Time: 
10-15 minutes. Manual including sample copy of Record Form, 
$1.50; package of 25 record forms, $1.50; manual and package 
of 25 forms, $2.75. Published by The Psychological Corpoia- 
tion. 


Kansas First Year Spanish Test, 1947, by Minnie M. Miller. A 100- 
item achievement test. Norms are based on high-school stu- 
dents. Working time: 40 minutes. Published by Bureau of 
Educational Measurements. 


Mental Health Analysis, Form A, by Louis P. Thorpe, Willis W. 
Clark and Ernest W. Tiegs, 1946. Designed to systematically 
ascertain presence of mental health liabilities and assets. No 
time limits. Separate tests are available at four levels; Elemen- 
tary, Grades 4-8; Intermediate, Grades 7-9; Secondary, Grades 
9-college; Adult. Package of 25 hand-scoring edition, $1.75; 
machine-scoring edition, 7^ per booklet; answer sheets, 2^ each; 
specimen set and accessories (at any level), 3Sij}. Published by 
California Test Bureau. 


Metropolitan Achievement Tests, New Forms R to V, by Richard D. 
Allen, Harold H. Bixler, William L. Connor, Frederick B. Gra- 
ham, and Gertrude H. Hildreth Measurement of school achieve- 
ment is the object of these revised batteries, ranging from 
Grade 1 through the first half of Grade 9. Several forms will 
be available at each level. Primary I and Primary II Batteries 
for Grades 1 and 2 respectively, are intended as skill tests. Total 
time estimated 100 minutes (including several separate testing 
sessions) Elementary Battery (Grades 3 and 4) contains six 
subject-matter tests. Total time. 135 minutes. Both Inter- 
mediate Battery Complete (Grades 5 and 6) and Advanced 
Battery Complete (Grades 7, 8, and first half of 9), each con- 
tain 10 sub-tests. Time estimates are 200 and 220 minutes, re- 
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specuvely. Partial batteiies aic available foi the Intermediate 
and the Advanced tests, 6 sub-tests comprising each. Also pub- 
lished separately aie aiithmettc and reading tests for the Ele- 
mentary, Intermediate and Advanced Batteries. Packages of 25 
tests with manuals, keys, class rccord.s and analy.si.s chart for 
Form R: Primary 1, 5^1.60; Primaiy II, 5^1.65; Elementary, J2.2.5; 
Intermediate, 5?2.70; Advanced, )52.7C);^ Intermediate Partial or 
Advanced Partial, $2.20-, Arithmetic Test (elenientary, inter- 
mediate or advanced), $1,40 per package; Reading Test, Ele- 
mentary, $1 55, Intermediate, $1.40, and Advanced, $1.40. Pub- 
lished by World Book Company. 


New California Short-Form Test of Mental Maturity, '47 S-Form, by 
Elizabeth T. Sullivan, Willis W. Claik and Ernest W Tiegs, 
1947. These tests are designed to measure both language and 
non-language factors of mental capacity. Five separate power 
tests are available at levels ranging from kindergarten to adult. 
Tests at the elementary level and above are “self-administering.” 
The tests aic administered in one period, with suggested time 
limits for sub-tests. Foims include Pic-Primary, (Kindergarten 
and Grade I); Primaiy (Giadcs I~III); Elemcntaiy (Grades 
IV-VITI); Intermediate (Grades VII-X and Adult); Advanced 
(Grades 9-Adult). Package of 25 hand-scoiing edition, $1.20; 
machine-scoring edition, 25--<)99, at each; an.swer sheets, 2^ 
each; specimen set and accc.ssorie.s (each level), Published 
by California Test Bureau. 


Number Fact Check Sheets, Forms A and B, hy Roy Cochrane, 1947. 
Mastery of addition, subtraction, nuiltiphcation and division are 
examined in this test. Entiie test printed on front and back 
of I.B.M. answer sheet. Norms available on Grade V through 
Grade VIII. Time: about 20 minutes. Hand or machine scor- 
ing. Package of 25 answer sheets, 75(f; hand-scoring stencil set, 
60;i. Published by California Test Bureau 


Ohio Social Acceptance Scale, by The Euclid Elementary Teachers 
and The College of Education, Ohio State University. Students 
are required to designate their degree of acceptance of each class- 
mate by choosing the appropriate paragiaph description. Issued 
by Louis E. Raths. 


Progressive Tests in Social and Related Sciences, Elementary Battery, 
Form A, by Georgia Sachs Adams and John A. Sexson, 1947. 
These subject matter tests arc arranged in 3 separate booklets, 
each composed of 2 sections. Suggested time limits for these 
power tests are. Part I, Social Studies I, The American Heritage, 
Peoples of Other Lands and Times, 50 minutes. Part 11, Social 
Studies II, Geography; Basic Social Processes, 60 minutes. Part 
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III, Related Sciences, Health and Safety; Elementary Science, 
40 minutes. Percentile Norms for Grades 4 through 8 Hand- 
scoung: Parts I and II, {51.2S per package of 2S, Part III, $1.00 
per package of 25. Machine-scoring booklets: Part I and II, 
each; Part III, 4^ each; answer sheets, 3^ each. Specimen sets 
(on any part) and accessories, 35^ each Published by Califor- 
nia Test Bureau. 


Revised Beta Examination, by D. E. Kellogg and N. W. Morton 
1946 Restandardization by R. M. Lindner and M. Gurvitz’ 
This revision makes possible the securing of Beta IQ’s similar to 
Wechsler IQ’s Contents and essentials of administration and 
scoring remain unchanged. Range- Grade 3 to adult. Time; 
30 minutes. Package of 25 with manual and key, $3.30. Speci- 
men set, 30f!. Published by The Psychological Corporation. 


Rich-Engelson Spelling T est, 1947, by Veinita Rich, H. E. Schrammel 
and leleen Engelson To be used for an indication of spelling 
accuracy of students in Grades 9 to 12, and college. Time: 30 
minutes. Published by Bureau of Educational Measurements. 


Science Research Associates Clerical Aptitudes, Form AH, by Rich- 
ardson, Bellows, I'lcnry, and Company, Inc., 1947. This test is 
planned to measure three aspects of clerical work: office vocabu- 
lary, office arithmetic and office checking. Total time for ad- 
ministration; 35 minutes. Reusable test booklet with answer 
sheet, 43;J; package of 25 answer pads, $1.65, package of 25 
profile sheets, 45^; specimen sets, 75^. Published by Science 
Research Associates. 


Science Research Associates Dictation Skills, by Marion W. Richard- 
son and Ruth A. Pedersen, 1947. For the purpose of testing 
dictation speed and dictation accuracy; two albums of records 
are available. No typewriter is required. Accuracy album, 
$6 00, -speed album, $9.00; reusable accuracy booklet with an- 
swer pad, 45^, reusable speed booklet with answer pad, 45^; 
answer pads for accuracy test, package of 25, $1.65; answer 
pads for speed test, package of 25, $1.65. Published by Science 
Research Associates 


Science Research Associates Language Skills, Form AH, by Marion 
W. Richardson and Ruth A. Pedersen, 1947. Designed to mea- 
sure vocabulary, spelling, word division and punctuation skills. 
The test is member of a battery of stenographic skills tests, and 
is expected to operate as a screening instrument in selection. 
Working time; 20 minutes. Cost; package of 25 test booklets, 
$1.90; specimen set, SOiji. Published by Science Research Asso- 
ciates. 
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Science Research Associates Mechanical Aptitudes, Form AH, by 
Richardson, Bellows, Henry, unci Company, Inc., 1947. De- 
signed to mea.surc separately mechanical knowledge, space rela- 
tions, and shop arithmetic. Time: .35 niimite.s. Current norms 
on high-schonl giadnates attending trade schools. Reusable test 
booklet with answer pud, 43{*. package of 25 answer pads, M.65; 
package of 25 profile sheets, 45^*; specimen sets-, 75^*. Published 
by Science Research Associates. 


Science Research Atsociates Non-Verbal Form, Form AH, by Robert 
N. McMurry and Joseph K. King, 1917. Series of pictured ob- 
jects compiisc the items of this test Semes are dependent on 
the examinee’s ability to reason out diffeiences No reading is 
required in the test proper. Time: 10 minutes. Range 12 to 
17 or over. Cost: package of 25 (self-scored) booklets, ?1 90; 
package of 25 (machine-scoted) booklets, M.30; p.ickage of 100 
answer sheets (machine-scored), ,52.35; sei of scoung keys 
(machine-scored), SOd; specimen sets, 51)^“. Published by Sci- 
ence Research Associates. 


Science Research Associates Primary Mental Abilities, Pieliininary 
Foim, by L. L. Thiirstonc and Thelma Clwinn Thuistone, 1947. 
This shortened and simplified version of the C'hicago Tests is 
planned to measure five competent abilities which have been 
statistically identified as discrete intellectual areas. The five 
sub-tests — verbal-meaning, space, leasoning, number, and word- 
fluency — arc contained in a single reusable booklet but are sepa- 
rately timed. Administration time estimated at 45 minutes. 
Range; Ages 11 to 17. Cost; lest booklet with amswei pad, 
43^, package of 25 answer pad.s, )^1.65; package of 25 profile 
sheets, 45^; specimen set, 75('. Publusbed by Science Research 
Associates. 


Science Research Associates Reading Record, by Guy T. Buswell, 
1947. This test is planned to help determine the present status 
of the student’s reading skill, and to estimate his specific reading 
strengths and weaknesses i dative to educational and occupa- 
tional goals Both speed and comprehension arc investigated 
in ten sub-tests published in a single reusable booklet. Adminis- 
tration time 40 minutes. Applicable to grades 8 to 13. Cost; 
test booklet with answer pad, 43(f; package of 25 answer pads, 
)51.65; package of 25 profile .sheets, 4S<;; specimen set, 75^!. Pub- 
lished by Science Research Associates. 


Science Research Associates Typing Skills, Form A, by Marion W. 
Richardson and Ruth A. Pedersen, 1947. A part of Science Re- 
search Associates Program of Stenographic Skills Tests for hir- 
ing or upgrading. Working time: 10 minutes. Cost; package 
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of 25 test booklets and work sheet, ^1 90; specimen sets, SOf 
Published by Science Reseaich Associates. ’ 


Science Research Associates Verbal Classification Form, Form AH, by 
Thelma Gwinn Thuistone and L. L. Thuistone, 1946. As a 
sboit forrn of the American Council on Education Psychological 
Examination and a leviscd edition of the Thurstone Test of 
Mental Alertness, this test is designed to measure general intel- 
ligence. Range: 12 to 17 or over. Time- IS minutes. Cost- 
package of 25 test booklets (self-scored), ^1.90; package of 25 
test booklets (machine-scored), $1.30; package of 100 answer 
sheets (machine-scored), $2.35, set of scoring keys (machine- 
scored), SO^-, specimen set (self-scored), 50(1 Published by 
Science Research Associates. 


Test on Social Usage, by Margaret Stephenson and Ruth Millett, 
1947. The purpose is to test fundamentals of courtesy and 
etiquette. Untimed Published by McKnight and McKnight. 


Thurstone Interest Schedule, by L L. Thurstone, 1947. A check 
list yielding 10 scores. Physical Science, Biological Science, Com- 
putational, Business, Executive, Persuasive, Linguistic, Humani- 
tarian, Artistic, Musical. Untimed (10 minutes estimated) 
Applicable at secondary school level and above. Published by 
The Psychological Corporation. 
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MEASUREMENT ABSTRACTS^ 

Aita, J. A., Armitage, S. G., Reitan, R. M. and Rabinovitz, A. “The 
Use of Certain Psychological Tests in the Evaluation of Brain 
Injuiy.” Journal of General Psychology, XXXVII (1947), 
25-44. 

This article reports on the diagnostic value of three specific psy- 
chological tests .in cases of hrain injury from military causes: the 
Wechsler Mental Ability Scale, the Shipley-Hartjord Retreat Scale 
for Intellectual Impairment, and the Hunt-Minnesota Test for Or- 
ganic Brain Damage. Experimental and control subjects were from 
Neurological-Neurosurgical Service wards of an Army General Hos- 
pital, the former including both focal and diffuse brain damage cases 
three to six months after injury, and the latter having been classi- 
fied as cases with no organic cerebral alteration. In general, the au- 
thors’ findings indicate that the Wechsler M.A.S. seems to have defi- 
nite value in the determination of brain damage, that the Shipley- 
Plartford is of doubtful validity, and that most of fhe Hunt-Mmne- 
sota tests show no differentiating ability. Vernon S. Tracht. 


Anderson, Rose G, “Test Scores and Efficiency Ratings of Ma- 
chinists.” Journal of Applied Psychology, XXXI (1947), 377- 
388. 

Supervisors’ efficiency ratings and the scores on the following 
tests were secured for 174 machinists. Adult Placement Test (devel- 
oped by the author), Bennett Mechanical Comprehension Test, Form 
AA, Revised Minnesota Paper Form Board T est, and the MacQuarne 
Mechanical Aptitude Test. The effectiveness of the different tests 
varied according to the specific.trait. A paper and pencil test of gen- 
eral intelligence, singly or in combination with others, was most dis- 
criminating in segregating machinists according to their efficiency 
ratings, tligh test scores and low efficiency ratings for twelve of the 
men indicate the importance of supplementing supervisors’ judg- 
ments and test scores with personal history ,and interview data. 
Leroy S. Bwwen, 


Assum, Arthur L. and Levy, Sidney, J. “A Comparative Study of 
the Academic Ability and Achievement of Two Groups of Col- 
lege Students.” Journal of Educational Psyrhologv, XXX\'TII 
(1947), 307-310. 

This is a study of the relationship of academic aptitude and 
achievement in equated groups of adjusted and maladjusted college 
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students. Aptitude was mea.surcd hy tlie ACE and Cnlk^e Reading 
Ability and College Writing Ability .scores, wlrile acliievenient was 
measured by the students’ p;radc.S‘ on comprehemsive examinations, 
The authors detected no significant differcm-cs between the groups 
with re.spept to aptitude, hut critical ratifi.s indicated a significant 
diffeience in achievement in favor of tlie adjusted group. Harold 
Mosak. 


Barrett, Dorothy M. and Katon, Klizahcth B. "Preference for Color 
or Tint and Some Related Personality Data," Journal of Per- 
sonality, XV (1947), 222-232. 

One hundred and fourteen college women were subjects in an ex- 
perimental investigation of the relatinn.ship of color or tint preference 
to characteristics of per.sonality. Retest rciiabilitic.s for 63 subjects 
for color and tint choices were .R,3 for tint score.s and .79 for color 
scores. Other tests completed by the .subjcct.s included word asso- 
ciation, estimation of dots, paper and pencil maxes, and nine attitude, 
interest, and personality scalc.s. Reliable differences in test results 
were found for eight of the tesc.s, between sul)ject.s preferring colors 
and those preferring tints. These differences arc interpreted as sup- 
porting the hypothesis that preference for color is associated with 
extratensivencss, and for tint with introvcrsivcnes.s, Frances Snilk 


Borow, Henry, "The Measurement of Academic Adjustment.” 

Journal of the American Association of Collegiate Registrars, 
April 1947. 

The author describes how the College Inventory of Academic Ad- 
justment was developed anti validated to meet the need for a measure 
of non-intellectual aspects in scholastic achievement. Believing that 
the disparity between the prediction of success (as measured by edu- 
cational aptitude tests) and cienronstrated proficiency (as revealed 
by earned grades) is in large pan attributable to attitudes, aspira- 
tions and personal practices outside the scope of such .scholastic tests, 
he devised a 90-item questionnaire compassing the following 6 cate- 
gories of academic adjustment: curricular, maturity of goals and level 
of aspiration, personal efficiency, study .skills and practices, mental 
health, and personal relations. All of these sections except the last 
gave significant, albeit relatively low, correlations with freshman 
grades. The over-all results indicate that the inventory can be use- 
ful in student counseling as an aid in finding sources of academic mal- 
adjustment. Vernon S, Tracht. 


Brozek, Josef, Simonson, Ernst and Keys, Ancel. "A Work Test for 
Quantitative Study of Visual Performance and Fatigue.” Journal 
of Applied Psychology, XXXI_ (1947), 519-S32. 

Six subjects were presented with a visual task consisting of the 
recognition of letters presented in random order on a belt moving 
behind a narrow slit, the recognized letters being recorded manually 
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by the subject. Practice periods to attain a performance plateau 
were followed by a two-hour work period for each subject with three 
work samples taken during this period. The level of illumination 
intensity was varied for each of three pairs of subjects. More ade- 
quate illumination was found to result in a higher general level of 
performance, a smaller fatigue decrement m output, and a smaller 
interindividual variability. The test is recommended as a standard 
method of studying the effect of different variables on performance 
and on visual fatigue. Frances Smith. 


Clarke, Helen J., Rosenzweig, Saul and Fleming, Edith E. “The 
Reliability of the Rosenzweig Picture-Frustration Study.” Jour- 
nal of Clinical Psychology, III (1947), 364-370 
The Rosenzweig Picture Frustration Test was administered to a 
group of subjects and then scored by four persons. The points of 
disagreement between the scorers were analyzed and scoring was re- 
vised accordingly. This procedure was carried out three times, in- 
creasing the reliability of scoring to a point of approximately 8S per 
cent agreement between two independent scorers. Leroy S. Burwen. 


Coleman, William “The Thematic Apperception Test. I. Effect 
of Recent Experience. II. Some Quantitative Observations.” 
Journal of Clinical Psychology, III (1947), 257-264. 

The possibility that T.A.T. responses reflect recent experiences 
was tested by administering to 41 children, ranging in age from 8 to 
134, two approximately equivalent parts of the T.A.T. before and 
after they had seen a motion picture. Results showed only 1 of the 
370 stories, obtained after the film presentation, was apparently di- 
rectly influenced by the movie’s content, suggesting that films of 
average dramatic intensity do not appreciably affect responses. The 
author reports his attempts to explore additional problems with the 
data compiled from the primary investigation, such as the relation of 
age and sex to mean level of response, characteristics of the most and 
the least productive pictures, predominant emotional tone of re- 
sponses for the various pictures, and finally, changes in emotional 
tone from plot to story ending Vernon S. Tracht. 


Davis, Robert A. and Rood, Edward J. “Remembering and Forget- 
ting Arithmetical Abilities.” Journal of Educational Psychology, 
XXXVIII (1947), 216-222. 

The authors, by administering the Schorling-Clark-P otter Arith- 
metic Tests to 56 junior high-school pupils. Investigated whether basic 
arithmetic skills are preserved while more complex material is being 
studied. Initial administration of the test occurred upon entrance 
into the seventh grade, and four times subsequently while the pupils 
were learning more complex material such as operations involving 
the use of percentages. Pupils evidenced progressive improvement 
upon each retest, but not uniformly for all operations, subtraction 
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and multiplication showing less improvement than division, fractions, 
and problems. Harold Mosak. 


Dvorak, Beatrice J. “The New USES General Aptitude Test Bat- 
tery.” Journal of Applied Psychology, XXXI (1947), 372-376. 
The author describes the manner in which the new USES General 
Aptitude Test battery was developed and .standardized. He also 
describes the types of occupational aptitude pattern.? indicated by 
the test, and the general u.scs of the battery. Also pointed out are 
some of the limitations of the test and the need for further develop- 
ment. Leroy S. Bitrwen. 


Gray, Horace. “Psychological Types and Changes with Age.” 

Journal of Clinical Psychology, III (1947), 273-277. 

Jung’s psychological types were examined by mean.? of a question- 
naire administered at varying times to 1000 isubject.? ranging in age 
from 10 to 80 and equally divided a.s to .se.x. Tlie .specific aim of the 
study was to ascertain differences in type revealed at different ages 
Calculating proportional frequency of t,xtraverf,s, intuitivus, and feel- 
ing-type individuals in each five-year age group, and avera^ng of 
ratings within each age group, both support the concKisicm that there 
is a slight progressive decrease with age in the feeling-function, defi- 
nite decrease in extravcrslon, and most marked dccrcasu in the intu- 
ition-function. Frances Switk. 


Hall, William E. and Cushing, James R. “The Relative Value of 
Three Methods of Presenting Learning Material.” Journal of 
Psychology, XXIV (1947), 57-62, 

This study first suggested itself during the recent war when the 
authors attempted to justify the Army’s expenditures for movie tone 
film for instructional purposes. In an effort to measure the relative 
effect of film, lecture, and reading, the authors selected three films, 
one informational, one theoretical, and one demnnstrational, and pre- 
pared them in lecture and mimeographed form. Administering these 
to three groups in controlled order, the authors found that no one 
method was significantly superior and suggest that “superiority in 
learning results from the relationship of the peculiar qualities of the 
learner to the method and is not inherent in the method itself.” 
Harold Mosak. 


Havighurst, Robert J, and Breese, Fay H, “Relation between Abil- 
ity and Social Status in a Midwestern Community: III. Pri- 
mary Mental Abilities.” Journal of Educational Psychology, 
XXXVIII (1947), 241-247. 

A comparison of scores on the Primary Mental Abilities Test 
made by all children born in 1932 in the three lowest social ^oups 
in a mid-wekern community is "consistent with the hypothesis that 
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high social position corresponds to high ability,” the lowest social 
group scoring definitely low on all tested abilities. This relationship 
is most pronounced between social status and the Number, Verbal, 
and Word Fluency factors. Sex differences were generally in favoi 
of girls except for the Space factor where boys were superior, and the 
Verbal factor where no significant differences were discovered. 
Harold Mosak. 


Kriegman, George and Hansen, Frank W. “VIBS‘ A Short Form of 
the Wechsler-Bellevue Intelligence Scale.” Journal of Clinical 
Psychology, III (1947), '209-216. 

To meet the need for a brief, easily administered, quantitative 
estimate of mental ability, 4 sub-tests of the Wechsler-Bellevue 
Intelligence Scale — Vocabulary, Information, Block Design and Simi- 
larities — ^were chosen to form a new test. The subjects were’ soldiers, 
approximately evenly distributed as to race and to urban and rural 
environments, of whom 409 were given the 4 sub-tests (VIBS) and 
89 the full Wechsler Scale. In addition the Clinical records of 118 
patients, referred for emotional problems, were used; none, however, 
was psychotic ip any of the groups in the study. The VIBS was 
found to be a quick, reliable and valid measure, especially helpful in 
differentiating normals from suspected mental defectives. Vernon S. 
Tracht. 


Lough, Orpha M. “Women Students in Liberal Arts, Nursing, and 
Teacher Training Curricula and the Minnesota Multiphasic Per- 
sonality Inventory.” Journal of Applied Psychology, XXXI 
(1947), 437-445. 

The MMPI was administered to 300 unmarried college women 
divided into four groups; 54 liberal arts students, 61 cadet nurses, 
74 elementary education majors, and 111 music education majors. 
All groups were comparable in terms of age. Results show all groups 
to be relatively stable with a slight tendency toward hypomania. 
There were no significant differences between groups on the separate 
scales. Nurse cadets in general had more masculine interests and 
were less emotional than the other groups. The author concludes on 
the basis of this and other studies that the MMPI has little or no 
value in educational selection. Leroy S. Burwen. 


Luchins, Abraham S. “Proposed Methods of Studying Degrees of 
Rigidity in Behavior.” Journal of Personality, XV (1947), 242- 
246. 

Techniques employed in experimental study of rigidity of be- 
havior are described under the following headings: arithmetical prob- 
lems, hidden-word tasks, pencil-and-paper mazes, ' series of drawings 
in which one design evolves through ambiguous stages into another, 
tapping rhythm, and set for color. Data obtained in various studies 
with normal children and adults add in a study by the author of 
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soldiers in neurnpsychiatric hospitals, indicate that the hospital pa- 
tients showed more rigidity. It is suggivsied that further systematic 
experimentation with the described and similar techniques will be 
of value both for clinical work and for the theory of personality 
dynamics. Franca Smith. 


Maker, Morton. "The Ability of Children to Read Cros.s-Sections,” 

Journal of Educational Psycholof^y, XXXVIII (1947), 157-1^, 

In one of a scries of studies on audio-visual aids, the author re- 
quired three groups of elementary-school ]nipil.s to match eight items 
and cross-sections of the.se items. A comparison of olnserved and 
theoretical frequencies of scores demonstrated that the observed scores 
could not be accounted for solely on the basis of chance, and necessi- 
tated the rejection of the hypothesis that pupibs arc unable to read 
cross-sections. An important implication of this .study is that chil- 
dren can be taught to read cioss-seciions as early a.s’ the fourth grade. 
Harold Mosak. 


Maker, Morton. “The Ability of Children to Read a Process Dia- 
gram." Journal of Educational Psycholof^y, XXXVIII (1947), 
290-298, 

Employing a diagram illustrating the flow of wheat in a flour mill, 
the author investigated whether clcmenrary-school pupils were 
capable of following the operations in diagrams of industrial proc- 
esses, Results obtained from 227 children from run .schools indi- 
cated that these pupils were not able to follow the flow of materials 
in the diagram, However, 34 pupils from a third .school were aided 
when the diagram was altered to include ".signposts" indicating the 
beginning and terminal points and direciions to follow the arrows. 
Harold Mosak. 


Morris, Woodrow W. “A Preliminary Evaluation of the Minnesota 
Multipliasic Personality Inventory.” Journal of Clinical Psy- 
chology, III (1947), 370-374. 

The MMPI scores of 320 naval personnel referred to the Neuro- 
psychiatric Service were studied in a preliminary evaluation of the 
test as a diagnostic instrument. Average scores of patients classified 
as “No Disease” and of patients in three pathological categories were 
all within the normal limit.s on Mf, Pa, and Ma scale.s, while all ab- 
normal patients scored significantly above 70 on D. T!)c Inventory 
was found to differentiate between borderline normals and serious 
pathological states, but not between pathological groups. It is 
recommended that the Inventory be used with caution as a diag- 
nostic instrument until a further critical evaluation is completed. 
Frances Smith. 
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Rabin, A. I. and Sanderson, M H. “An Experimental Inquiry into 
Some Rorschach Procedures.” Journal of Clinical Psychologv, 
III (1947), 21S-22S. 

Of a group of 34 student nurses, 17 (group I) were given the 
Rorschach in standard order and 17 (group II) were given it with 
the order of the cards reversed. Two months later the procedure was 
repeated, except that this time group I was given the reversed order 
and group II was given the standard order. From these data the 
authors present conclusions relating to the order of cards, “experience 
balance,” difficulty of cards and color shock. Leroy S. Burwen. 


Remmers, PI. H. and Weltman, Naomi. “Attitude Inter-Relation- 
ships of Youth, Their Parents, and Their Teachers ” Journal of 
Social Psychology, XXVI (1947), 61-68. 

To test the broad hypothesis so prevalent in our Western culture 
that youth is inevitably in conflict with his elders, and specifically to 
find how greatly youths’ attitudes vary from those of their parents 
and teachers, the Purdue Opinion Poll for Young People No 7 was 
given to 207 students fiom 10 senior high schools in rural Illinois and 
Indiana and to their parents and teachers. In addition to the 16 
opinion items, the poll contained questions on home environment, 
political preference, school grade, sex, and place of residence. Re- 
sults indicate a high degree of similarity of opinion between parents 
and children, less so between teacheis and their students or between 
teachers and parents. Vernon S. Tracht. 


Sherman, Arthur Wesley, Jr. “Emancipation Status of College Stu- 
dents.” Journal of Genetic Psychology, LXVIII (1946), 171- 

180. 

This describes the development of a questionnaire, suitable for 
older adolescent college students of both sexes, which would indicate 
whether a subject was emotionally free from his parents Sixty 
Items were devised and scored with the idea in mind of securing a 
single numerical index of emancipation status Subjects qualifying 
for the study included 238 men and 200 women, all from classes in 
psychology and sociology, the majority being under 20 years of age. 
The relation of emancipation status to other variables (such as sex, 
age, length of residence in college and socio-economic status) was 
studied by a comparison of the most and least emancipated groups, 
the greatest difference between them being found in sex. Since the 
other variables showed meager relations, the author suggests that 
future studies concent themselves with the parent-child relationship 
and with parental controls exercised therein. Vernon S. Tracht. 


Triggs, Frances O. “Critique of Van Allyn’s System of Vocational 
Counseling.” Journal of Applied Psychology, XXXI (1947), 
536-544. 

The author states that the Joh Qualifications Inventory and the 
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Job Placement Reference as developctl and used by Van Allyn in his 
system of vocational counseliiiR need further invcstiRaiion. The JQI 
is concerned primarily with sustained, verified interest, which Van 
Allyn feels is the main criterion foi good vocational counseling, al- 
though he points out that minimal intelligence and physical stand- 
ards for any job must be met. Triggs concludes that the theory and 
the instrument implementing it both require further validation. 
Leroy S. Burwen, 


Triggs, Frances 0. “The Measured Interests of Nurse.s.” Journal 
of ^Educational Research, XII (1947), 25-34. 

To supplement ability and aptitude ratings in vocational counsel- 
ing, the author employed the Kuder Preference Record to measure 
the interests of women in the nursing profession. The Preference 
Record, administered to 1429 women from various occupational 
groups and 826 nuises, demonstrated significant differences at the 
1 per cent level in all interest areas except the Artistic where the 
difference was at the 5 per cent level of significance. Differences were 
positive (i.e., In the direction of the nurses) on the Social Service, 
Scientific,' Artistic, and Musical scales and negative on the Clerical, 
Computational, and Literary scales. Harold Mosak. 


Witty, Paul. “Reading Retardation in the Secondary School.” 

Journal of Experimental Education, XV (1947), 314—317. 

Studies demonstrate that while formal instruction in silent read- 
ing is discontinued in the fifth or sixth grade, many pupil.s have not 
developed fundamental reading skills and are as a result handi- 
capped in the acquisition of knowledge in the history, science, and 
language areas. Intelligence and reading tests were admini.stcred to 
one hundred ninth-grade pupils referred as reading problems to the 
Northwestern University Psycho-Educational Clinic. Analysis of 
the data reveals the following factors — ’poor reading habits, 'physical 
defects, deficient Interest, and emotional maladjustment — as charac- 
teristic of this group. Suggestions for the establishment of remedial 
reading classes in the secondary school are included. Harold Mosah. 
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ARE VOCATIONAL ORIENTATION COURSES 
WORTH THEIR SALT? 


C. HAROLD STONE 
University of Minnesota 

Are courses in occupations a substitute for individual 
counseling? Can we achieve desired ends in a student person- 
nel program by lightening the counselor’s load through referral 
to him of only the problem cases, and by “counseling” the 
majority of students through the medium of group guidance 
classes? What, if anything, do vocational orientation courses 
contribute to the facilitation of the individual counseling 
program? Which is better — a well-formulated sequence of 
courses in vocational orientation or a comprehensive program 
for counseling students individually? Or, are there worth- 
while values to be gained through an integration of individual 
counseling and group guidance functions? Definitive answers 
to these questions would carry us a long way toward a clearer 
understanding of what procedures and techniques hold the 
most promise for providing optimal educational and vocational 
guidance for students. 

The results of evaluation of the vocational orientation se- 
quence in the General College, University of Minnesota, 
reported in this paper, suggest certain possible answers to 
some of the questions posed above. It is the earnest hope of 
the author that they will serve to stimulate further research in 
this area to provide additional knowledge concerning the ap- 
propriate place and function of certain techniques in student 
personnel workd 


^ A report of the evaluation study was published by the Committee on Educational 
Research in I94I (15). However, government restrictions on paper and other con- 
siderations limited the printing to a few hundred copies. The volume of requests for 
copies of the study has continually increased since exhaustion of the original supply 
several years ago. As a result, and at the urging of others, the author has submitted 
the report with minor revisions for publication in a professional journal of sufficient 
circulation to reach an appropriate audience. 
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Vocational Orientation in the General College 

The courses in vocational (rrientation in the Cicneral College 
are the result of several years of devchipment. In 193a, at 
the time the University Junior College^ was established, a 
course in vocations was instituted as an elective. During the 
yeais 1936 “dH, The Choice of an Occupation was a required 
course for the Psychology Comprehensive Examination and a 
part of an Economic comprehensive wlticlt also included Our 
Economic Life and the Mathematics of Business. The present 
status of the vocational orientation area in the Clcneral College 
is an outcome of the ig3f< proposal tliat four orientation areas, 
namely, Home Life, Individual, Social-Civic, and Vocational, 
be included in the curriculum. 

As one of the orientation areas, the vocational orientation 
sequence was composed of three courses at the time of this 
study. The foundation course of the sequence. The Choice 
of an Occupation, was concerned with students’ vocational 
choices. Because large numbers of students make obviously 
illogical and sometimes fantastic job selections, in terms of 
individual interests, aptitudes, abilities, and experiences, the 
course was aimed at developing an understanding of the prob- 
lem of job selection which would create an awareness of the 
need for advice and help from competent sources. The 
materials presented to the students in this first quarter of work 
may be divided into four main sections: educational opportuni- 
ties, human patterns, job patterns, and trends in employment, 
In the second quarter. The World of Work, occupational 
information was placed in a socio-economic setting and em- 
phasis was given to relationships among workers and in- 
dustries. To meet a need expressed by many students for a 
more individualized technique for exploring materials which 
fitted their particular vocational problems, the Vocational 
Orientation Laboratory was established. Whereas the first 
two quarters of work were tauglit primarily by classroom 
lectures, individual work and participation in small interest 
groups received first consideration in the laboratory. Students 
made a careful job analysis in the occupational field of their 


* Later named the General College. 
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choice In addition to conducting specific investigations of job 
and training opportunities m the Twin City area (4, 5, 6). 

Evaluation Objectives 

Following the establishment of the four orientation areas, 
the General College asked the assistance of the University 
Committee on Educational Research in making an appraisal 
of the new program in vocational orientation. A subcommittee 
was appointed and work was begun under the chairmanship of 
Professor Donald G. Paterson of the Department of Psy- 
chology.^ A two-year project was planned, with the first year 
devoted to an exploration of the most suitable methods of 
investigation of the problem and the second year to the ap- 
plication of the methods developed in the first phase of the 
study 

The major objective of the st udy was to determine the extent 
to which the vocational orientation courses assisted students 
inlnaking more appropriate vocational choices; ' In addition, 
it was proposed to evaluate the effectiveness with which certain 
other objectives of the course, as outlined by its sponsors, were 
being achieved, since findings from such a study would be of 
considerable significance to the problem of vocational counsel- 
ing throughout the University. In particular it was hoped to 
determine the extent to which group counseling and instruc- 
tional methods can (i) solve certain students’ vocational 
problems, (2) sift out the students who need individual clinical 
guidance, and (3) reduce the time necessary for individual 
counseling after preliminary orientation 

Procedures Used in the Evaluation '' 

In conducting the investigation, tests and questionnaires 
were administered and ratings of vocational choices were made 
both at the beginning and at the end of the experimental period 

“ Members of the cvnluntion committee were' Malcolm S McLean, T. Raymond 
McConnell, Edmund G. Williamson, John G. Darley, Ivol SpafFord, Marcia Edwards, 
Ruth E. Eckert, Milton E. Hahn, C. Harold Stone, and Donald G. Paterson, chair- 
man. 

■* Since the work of the first year was primarily exploratory in nature, a detailing of 
research activities is not recorded here. The main organizational change resulting from 
the exploratory program was the establishment of the laboratory approach, to the study 
of vocations at the beginning of the Winter Quarter, 1939 
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The experiment was liiniled to members of the Freshman class 
since the majr)iity el' students whn elected to enroll in the 
vocational sequence did so in tlteir first year. To allow 
adequate time fur tive testing, a ilay was set aside during the 
first week of the Full Quarter fur tire pretest and another during 
the Spring Quarter fur the letest. 'I’he entire ITeshman class 
was given the battery of tests and questifinnaires. This group 
was divided later into the students wliu actually took the 
vocational firientation sequence during the yeai ami those who 
di<l not. 

The following techniques and measures were used as the 
primary bases for evaluating the effectiveness of the vocational 
orientation core courses: 

A. Sources for obtaining general background information: 

I. (Tcncral College Individual Record Form, from which 
was obtained such information as family background, 
educational history and planning, staled vocational 
choice and claimcil interest, extracurricular activities, 
hobbies, etc 

2 The vocational autobiography: a 2,000-woni paper 
written by the sttulent covering present and past 
vocational choices and including a discussion of the 
factors that have influenced these clioices, a work 
history, and plans for the future. 

3. A questionnaire designed to lietermme the amount of 
counseling a student had in high school and by whom 
he was counseled. 

4. Individual student case folders on file in the counseling 
office which contained complete records of all ability, 
aptitude, Interest, and personality tests taken by the 
students, as well as information obtained by faculty 
advisers and counselors in personal interviews. 

B. Measures used in both the pretest and retest batteries; 

I. A comprehensive test of occupational information 
composed primarily of the mOvSt discriminating items 
of previous tests. 

2., An attitude scale adapted by Williamson and Darley 
from the Occupatmial Attitude Scale of Miller and 
Remmers covering seven general occupational fields. 
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3 Remmer’s of Specific Jttitudes toward a Vocation 
to determine student attitudes toward their own vo- 
cational choice. 

4. A form developed by the Evaluation Committee to 
determine the training desires of students in various 
vocational and cultural course sequences. 

5 Preliminary form of the Minnesota Personality 
Scale to obtain measures of student adjustment 

6 An adjustment scale developed by the Individual 
Orientation Evaluation Committee to obtain addi- 
tional evidence of adjustment or maladjustment 
among students. 

C Additional measures and techniques applied at time of 

the retest; 

I. A special questionnaire to determine changes in 
attitude and thinking of students on vocational prob- 
lems as expressed in the autobiography written at the 
beginning of the year. This form also sampled reac- 
tions to vocational counseling received during the 
year 

1 A ranking by students in order of preference, of all of 
the courses in which they were enrolled during the ex- 
perimental period 

3. An evaluation of occupational choices in relation to 
claimed interest, high-school record, measured in- 
terests, and other test and clinical data An attempt 
was made to determine the consistency of the voca- 
tional choices a student listed at the beginning and 
the end of the year in relation to his measured abilities 
and capacities. 

4. A determination of student reactions to the vocational 
orientation courses. For this purpose, both objective 
and written responses were obtained from students at 
the end of each quarter. 

Data obtained from measuring devices and evaluation tech- 
niques listed above, togetlier with information drawn from in- 
dividual case folders on file in the counseling offices, were an- 
alyzed in relation to counseling patterns, course sequences, sex, 
and reasonableness of vocational choice 
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StudciU Groups Included in the Study 

In making compaiisnns between students in the contiol group 
and tliose taking vocational courses, experimental groups were 
established according to the course sequences chosen by various 
students. Thc.se are: 

I. Combined Experimental. N — ii8. This group included, 
all students who were enrolled in vocational orientation 
coursc.s during the year and took the complete pretest and 
retest batteries. 

1 . Experimental I N - 8o. Composed of students who 
took the Fall and IVintei Ihuajter lecture courses, namely, 
The Choice of an Occupation, and The World of Work 

3. Expci mental 11 . N ~ la. Students eni oiled only di 
first lecture course, (I'he Choice of an Occupation) and in 
the Focational Laboratory. 

4. Experimental III, N = a6. vStudents wlio took the 
entire vocational oiientation sequence, i.c,, both lecture 
courses and the Jpcattonal Laboratory. 

5. Control Group. N ~ 140. All freshmen not enrolled in 
any of the vocational orientation courses and who took 
the complete pre- and post- test battery. 

The Control and experimental groups appear to be well 
matched on such factors as age, aptitude rating, high-school 
rank, measuies of adjustment, and father's occupation. Of 
most immediate interest, perhaps, is the question of aptitude 
rating and high-school rank, since it is to be remembered that 
this group, although typical of the General College freshman 
population, is not typical when considered in relation to the 
total freshman population of the University of Minnesota. 
The mean aptitude test rating of the control group on the 
American Council on Education Psychological Examination is 
equivalent to a percentile score of 15 on all university of Min- 
nesota freshman norms I'kir the combined experimental group 
the mean percentile is 19, d’he average high-school percentile 
rank of students in the control group is 34.5. Tlic high-school 
rank for the combined experimental group is 33.8. 



VOCATIONAL ORIENTATION COURSES 


167 


Results 

Gains in Vocational Information 

As one might expect, students who were enrolled in the 
vocational orientation sequence made greater gains in occupa- 
tional information during the year than did students in the 
control group. At the beginning of the year, the mean scores 
for the combined experimental and for the control groups were 
almost identical. At the end of the year both groups showed 
gains. Residence in college for one year served to increase 
slightly the amount of information about jobs which students 
in the control group possessed. However, students in the ex-' 
perimental groups made significantly greater gains than those 
in the control. An analysis of covariance between the control 
and the combined experimental produced an F of ii 08 on the 
retest at the end of the year. The i per cent level of signif- 
icance was 6.76. When final scores were adjusted for dif- 
ferences in initial scores, an F value of 17 07 was obtained, 
indicating that students in the experimental group gained 
significantly more than members of the control group. In the 
subgroups it was found that students who were enrolled in the 
laboratory section made somewhat larger gains than did those 
who were enrolled in the lecture sections only. 

Levels of Aspiration 

The levels of aspiration for students in various groups may 
be ascertained through consideration of a number of the meas- 
ures used in this investigation Expressions of attitudes 
toward occupations, salary expectations, and vocational choices 
classified on the Minnesota Scale of Occupations, contribute 
to an understanding of the types of vocational goals aspired 
to by these General College students. 

Attitudes toward Occupations — In general, at the beginning 
of the year the students studied favored types of work involving 
executive responsibility, business contacts with people, artistic 
work, and technical or scientific work, in the order named, 
The type of work favored least was that which involved business 
detail. Differences on the general attitude scale from which 
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these results were obtained were statistically significant in but 
two instances aiul shoued for the most part that the control 
and experimental groups were quite s'imilar in their attitudes 
toward jobs. 

By the end of the year cettuin changes in attitude had oc- 
curred. Only those changes which satisfleil the 5 per cent level 
of .significance are presented here The combined experimen- 
tal groups sltowed a ntuch less favorable attitude toward 
occupations involving .social service activities at the end of the 
year. Except for Experimental IH (Fall and Winter lecture 
sequence plus laboratory) all groups were less favorable to oc- 
cupations requiring special artistic abilities. In attitudes 
toward occupations involving executive responsibilities, only 
Experimental 11 showed a significant change, and this was in 
a direction less favorable to executive work Technical or 
scientific work was considered much less desirable by students 
in both the control group and m the combined experimental 
group at the end of the year than tliey had rated it at tlic be- 
ginning of their college work. Students in the control group 
looked on occupations involving verbal or linguistic work with 
much less favor at the end of the year than at the beginning. 

If the vocational orientation courses were a.ssisting in the 
distribution of student vocational choice.s to levels more ap- 
propriate to their abilities one would rightfully expect to find 
students less favorable at the end of the year toward types of 
work demanding extended academic training. One demon- 
stration of such an outcome is the change in attitude toward 
the social service occupations, most of which involve at least 
college graduation and often postgraduate work, Changes in 
attitude toward artistic occupations suggest that some factors 
in the General College were operating to cause all students to 
favor such work as a career less at the end of the year, and the 
vocational orientation courses operated to accentuate these 
changes. It is not clear what factors were operating to cause 
the change in attitude of the control group toward verbal 
and linguistic work without accompanying changes in the 
experimental group. 

'A criticpl ratio of i 96 or more was considered as signlficnnt. 
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Salary Exfectations — Changes in students’ estimates of the 
monthly salaries they expected to receive their first work year, 
at the end of five years, and at the peak of their earning power, 
did not follow any consistent trends which might suggest the 
influence of the vocational orientation courses. The mean 
salary expectations for men students m all groups were ap- 
proximately $120 per month for the first year on the job, $240 
per month after five years of work, and $450 per month for 
peak earnings. These estimates were made at the end of the 
experimental period and are not significantly different from 
estimates made at the beginning of the year 

Levels of Vocational Choice. — Occupational choices of male 
students and the occupations of their fathers were classified 
on the Minnesota Occupational Scale (3) in order to reveal 
whether the vocational orientation courses were performing 
the function of “downgrading” student vocational choices to 
more realistic levels Student choices and fathers’ occupations 
were compared also with occupations of employed males in 
the United States classified on the Minnesota scale by Smart 
(9) from the 1930 census. As might be expected in dealing 
with a college group, the occupations of students’ parents 
showed a slightly larger percentage in the professions and in 
semiprofessional and managerial occupations than is true of 
Smart’s general population group. In the Minnesota Occupa- 
tional Scale, occupations are classified as follows. 

Class Occupation 

I. Professional 

II Semiprofessional and managerial 

III. Cleiical, skilled trades, and letail business 

IV Farmeis 

V. Semi-skilled, minor clerical, and minor business 

VI. Slightly skilled trades and other occupations requir- 

ing little training or ability 

VII. Day laboiers of all classes 

At the beginning of the experimental period students in the 
control group had choices which varied little from those of 
students in the experimental group except for Class II. A 
much larger percentage of control choices fell in this classifica- 
tion. As one might expect, both groups showed a rather large 
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percentage of choices in Class I. The relationships may be 
seen in Table i 

By the end of the year, students in the experimental groups 
appeared (o have adjusted their vocational choices more readily 
to lowei levels approximating the occupational levels of their 
parents than did students in the control group. Members of 
the control group showed an even less realistic pattern of choices 
at the end of the year than at the beginning and were much 
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farther away from the occupational classifications of their 
fathers. 

Although Tabic i presents data for only the Combined Ex- 
perimental Group and Experimental I in addition to the 
Control Group, the trends for the other experimental sub- 
groups were all in the same direction, which would tend to lend 
further significance to the results shown for the combined 
group. From the. changes observed, it would appear that the voca- 
tional orientation courses were serving to downgrade the occupa- 
tional aspirations oj students to more realistic levels. 

Appropriateness of Vocational Choice 

Although the downgrading of vocational choices of some 
students is to be regarded as a significant outcome, too much 
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credence should not be given, without further examination, to 
the appropriateness of these changes of choice. The change 
of a student’s choice to a more appropriate level does not 
necessarily mean that he has selected a vocation that is in 
accord with his pattern of interests, abilities, and capacities.® 
The suitability of the choice of each Individual was therefore 
carefully rated by members of the General College counseling 
staff from data provided by individual case studies Meas- 
ures of appropriateness of choice were obtained by comparing 
counselors’ ratings of students’ vocational possibilities with 
stated vocational choices of the students at the beginning and 
end of the experimental period. 

Accepting the premise that a particular pattern of abilities 
and interests allows an individual to cover a range of occupa- 
tions within one or several broad fields of work, ratings were 
made in broad areas instead of indicating a specific occupation 
for each student. Going even further, counselors indicated 
not only one broad field of work in which each student ap- 
peared to have potentialities for successful adjustment, but m 
many cases listed as many as three alternatives. These al- 
ternatives were listed in the order of the counselor’s judgment 
of the student’s potentialities in each field. Within each broad 
area three levels were presented based on a hierarchy of the 
intelligence and training necessary for successful competition 

The broad areas on which judgments were made were ten 
in number and were based on T. L. Kelley’s Classification of 
Human Abilities, including one general category listed as 
“practical” (10, ii). The ten fields in the ability classification 
of occupations used are listed below with a brief description of 
each : 

1 . Verbal and linguistic — fluency in use of one’s own language 
and facility in learning other languages. 

2. Scientific — facility in defining, classifying, grasping prin- 
ciples, inductive reasoning, perceiving relation of rule to ex- 
ample. 

3 Mathematical — facility with abstract symbols (and rela- 
tions of cause and effect). Perception of complex number 
relations. 

* However, even though students’ individual choices may not be good, counseling 
IS facilitated if alternatives fall at an acceptable le\)€l 
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4. Cleiiciit and coniinemal at curacy and .speed in liandling 
numlieus, name.s. systems, and details. 

5. Constructive and mechanical perception of .spatial re- 
lations, facility in desiLming. calculating, working with machin- 
ery, etc 

(). Manual skills -tlexterity in using tools, skills with hands 
and fingcr.s, prccLsion in cootdinating movements. 

7. Artistic-- appreciation of form aiul color, facility in crafts 
and in imaginative interpretations. 

8. Kxecutive- initiative, self-reliance, ambition, leadciship, 
etc. 

g, Social — sociability, cooperativene.ss, tact, personal pleas- 
ingness, helpfulness. 

10. Practical— efficiency in practical affairs, calmness under 
pressure, persistence, courage. 

In making ratings of appropriatene.ss of choice, foui classifica- 
tions were used' Optimal.^ where the student’s choice coincided 
with both the field and level suggestetl by the counselor; Fair, 
where the student’s choice was in the same field hut at a dif- 
ferent level from the counselor’s rating; Pm\ where neither 
field nor level coincided; and Mo Choice, where the student 
had made no vocational decision.’ In this report, only the 
optimal and poor choices have been graiihed for ilescriptlve 
purposes. In addition, no attention has been given to sex 
differences. 

A comparison of changes in vocational choices of students 
in the control group with those of students in the experimental 
groups reveals relationships which have important implica- 
tions for guidance programs of both the tiaditional group type 
and those utilizing the more comprehensive clinical method 
(12, 16). 

When no consideration was given to the counseling received 
by students, the percentage of poor clioices was not reduced by 

’ To deternime the coushlcncy of counselors' iiitinRs in this sualy tl\rc« counselors 
mndc independent rntinys ol the same fifty cases. In Limipiii'i lift" the oecupadonnl 
possibilities li.sted by tlie counselors, Counselor!. I and II luid at kfist one uRrecmenc in 
each of tbe filty cases (in many instances itioie than one vocational aUernative was 
listed by a coun.sclor). Coiinsolor.s I and III agreed with tbe .same high con.si.stency-- 
at least one agreement on oeciipational alternatives in every case. Counselors 11 and 
III had at least one agreement in forty-seven out ol the fifty cases, or (j.i pci cent of the 
time. 
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is far greater in tlie experimental groups. S'tudoits who teceiuea 
i)istructio)i hi vocational orientation in addition to individua 
counseling made vumked gains in the propoition of optimal choices 
by the end of the year. Conversely, students who received instruc- 
tion but wcie not counseled, showed much greater decrements in 
optimal choices than students in the contiol gpotip who received 
neither counseling nor instruction. 

An analysis of the changes in percentage of poor choices 
during the year reveals additional trends which Rirther chal- 
lenge the use of courses in group guitlancc without providing 
adequate supplemental intlividual counseling Students who 
received instruction in vocational orientation but were not 
counseled during the year were no better oft' than students in 
the control group who were not counseled. Figure II shows 
this relationship. It will be noted that the lines for non- 
counselcd students in all three groups closely approximate one 
another. In the counseled group there is a reversal of trend. 
The combined experimental group anti Experimental I both 
show a reduction of poor choices for the counseled students. 
Control students who leceived counseling show a slight increase 
in proportion of poor choices hut the cirange from initial to final 
status is much less marked than is true for tho.se who were not 
counseled. 

Trends in the laboratory groups (Experimental H and III) 
were in the same direction as for the lecture group (Experi- 
mental I), However, fewer laboratory students who were not 
counseled had poor cltoices at the end of the year and there 
was a smaller decrement in optimal choices during the year. 
There was little difference in gains in optimal choice between the 
counseled laboratory and lecture groups. On the other hand, 
counseled laboratory students showed a marked reduction in 
proportion of poor choices by the end of the year. 

From the general trend of the results, those most closely 
associated with the evaluation study judged that the second 
quarter lecture course dealing with information about jobs 
was not as effective in assisting students to better vocational 
choices as the first quarter of the sequence which dealt with 
individual diJfferences and specific steps to follow in choosing 
an occupation. Where occupational information was directed 
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to the individual as m the laboratory approach, it appeared to 
be more effective. 

Other analyses were made to discover differential factors 
in student vocational choices. Students who changed their 


BEGINNING 



PERCENTAGE PERCENTAGE 

POOR CHOICES POOR CHOICES 

Fig. II. Effects of Counseling on Poor Choices of Students in Different Groups 

choice 'during the course of the year were separated from those 
who had maintained the same choice. When these groups were 
considered in relation to counseling, it was found (as would be 
expected) that students who had made changes tn choice made 
them in the same directions as shown in Figures I and II, and 
the change from initial to final status in each group was much 
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greater. For .students who had made )io c/iatiges i]i choice, 
counseling again appeared as an important factor. In all 
groujis, a much larger peicentagc of students v.ho were coun- 
seled maintained good choices than was true of the noncoun- 
scled groups. Conveusely, a very small percentage of students 
in the counseled grtiups persistetl in poor choices during the 
year. In the noncounseled groups a much larger proportion 
of students expressed the same inappropriate choices at the 
end of the year that they had at the heginning. The vocational 
atictiCci(t 07 t course supple^ncutcd by coiaise/itiy; teas much more 
effective m causing students with poor choices to change them than 
sms caunselhig alone. 

Reactions of Rtaff Counselors 

Since these results reveal definite values front the combina- 
tion of vocational courses and ctninscling, it appeared likely 
that statements from the counselors who dealt with the students 
might provide additional information concerning the way in 
which such a combination actually functioncii in individual 
cases. Both of the full-time staff counselors therefore were 
asked to indicate whether or not ddl'ercnccs had heen observed 
in the counseling situatum between students enrolled in the 
course and those who were not. The counselors' statements 
(prepared independently) are given below; 

Royal B, Kmbree, Jr., instructor and research counselor; 

It IS inipo.s.sible to provide an objective or quantitative 
estimate of the value of vocational oiientation eounses to the 
individual counseling activity cainetl on by (iencral College 
counselois. A subjective levicw of cxpeiicnce with many 
interviews would lead me to believe that these coui.ses aie of 
great value to the counselor Classes in vocational oiienta- 
tion have furnished good initial oiientation to the vaiious meas- 
uring devices u.scd m General College, as well as a sound 
foundation upon which vocational counseling interviews can 
be oigani2ed. Vocational autobiographies, supplied by these 
couises, are valuable adilitions to tlie peisonncl records. 
Finally, vocational orientation courses have been a definite 
force in motivating students to come for counseling interviews. 

Cornelia Taylor Williams, instructor and re.scarcli counselor: 

It is my distinct impression that students who had had, or 
were taking, the vocational orientation course were easier to 
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advise on vocational and educational problems than many of 
those who had not had the couise. Students who came in for 
vocational advice often told me that they needed to knowsome- 
about their own abilities and limitations They seemed to 
have enough preliminary and basic undeistanding of “apti- 
tude testing” so that explanation and interpietation to them 
of their own test scores was casiei than for students who had 
not taken vocational orientation. They were, in other words, 
"softened up” to the point where they weie ready for counsel- 
ing, and could see some value m it, and they weie well enough 
prepared for the interview so that the test interpretations pro- 
ceeded more smoothly. They asked more intelligent and pene- 
trating questions, and they understood better what I was trying 
to tell them. 

It would appear then that the vocational orientation courses 
served as a preparation for counseling and tended to reduce the 
amount of time necessary for the resolution of vocational and 
educational problems. 

Measures of Adjustment 

The achievement of more adequate social and emotional ad- 
justment has been suggested as a significant outcome of voca- 
tional orientation courses. For this reason, two rather com- 
prehensive measures of adjustment were employed. The first, 
a preliminary form of the Minnesota Personality Scale (i), 
provided measures of adjustment in five areas, namely: 

I. Morale 

II. Social adjustment 
III Family relations 
IV. Emotionality 
V. Economic conseivatism 


The second, the Individual Orientation Adjectives Pest (2) 
which was developed in connection with the evaluation of the 
individual orientation area, provided four types of scores 
which seemed useful foi this purpose. These four categories 
are: 


I General characteiization or pattern of individual’s total 
behavioi 

II, Typical behavior as a resiilt of motivation 
III Characteristic feelings of individual 
IV. Social characteiistics of individual 
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<'Ou the Mvmesota Pcrsoualily Scale the control group 
nude no significant changes on any of the five factors covered. 
Tlie cxpcriniental groups registered significant changes only- 
in the area of social adjustment. An investigation of the effect 
of counseling on adjustment revealed an interesting outcome. 
Students in the combined experimental group who were not 
counseled showed no significant changes on any of the measures 
in this test. However, students who were counseled showed 
significantly better social adjustment at the end of the year, 
as measured by this test. Similar breakdowns for the control 
group revealed no significant changes. 

On all four divisions of the Individual Orientation Adjectives 
lest only very slight changes were recorded in all groups. 
These same results held true when groups were divided ac- 
cording to counseling received and according to course se- 
quences in which students were enrolled. 

These results suggest that student adjustment does not show 
very marked changes as a result of one year’s residence in the 
General College. However, a combination of counseling and 
course instruction in vocational orientation does produce significant 
changes m the social adjustment of individuals as measured by 
the Minnesota Personality Scale. 

Summary and Conclusions 

During the school years of 1938-39 and 1939-40 the Com- 
mittee on Educational Research of the University of Min- 
nesota conducted an evaluation study of the core courses in 
the Vocational Orientation Area in the curriculum of the Gen- 
eral College The first year of the investigation was explora- 
tory in nature. The results described in this report were 
obtained during the second year. The vocational orientation 
seqvrence included two lecture courses; Choice of an Occupa- 
tion, and The World of Work, and Laboratory sections in 
which individual work was emphasized. Freshmen wlio were 
enrolled in the vocational orientation courses formed the ex- 
perimental groups and the balance of tlie T^'reshman class served 
as the control. A total of ajS students had records which Were 
complete enough to warrant their inclusion in the study. The 
combined experimental group numbered 118 students and there 
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were 140 students in the control. In order to determine 
changes which might be attributed to the teaching of voca- 
tional orientation, a variety of measures was administered at 
the beginning and end of the year to all members of the Fresh- 
man class. Studies were made of changes in occupational in- 
formation, attitudes toward occupations, salary expectations, 
levels of vocational choice, suitability of vocational choice, 
direction of changes of vocational choice, and social and emo- 
tional adjustment. 

An analysis of results suggest the following conclusions: 

I. The vocational oiientation courses in the General College 
provided students with more information about jobs than 
students gained outside of the course through undirected and 
incidental reading. 

1 . Changes in attitudes towards occupations in both the 
control and combined experimental groups reflected less favor- 
able attitudes at the end of the year toward technical and 
scientific work and occupations involving artistic abilities. 
The combined experimental group showed significantly less 
favorable attitudes toward social service occupations which 
normally require extended academic training. Students in 
Experimental II (course sequence; Choice of an Occupation 
and Vocational Laboratory) were less favorable toward work 
involving executive responsibilities, and control students were 
less favorable toward occupations involving verbal or linguistic 
work. 

3. The vocational orientation courses did not bring about 
any changes in the average salary expectations of students 
which would not normally arise from a year’s residence in the 
General College. 

4. Students in the experimental groups tended to adjust 
their vocational choices to more appropriate levels than stu- 
dents in the control group. 

5. Vocational orientation courses alone did not cause stu- 
dents to make more appropriate vocational choices in terms of 
their abilities, aptitudes, and interests than did mere residence 
in college. 

6. Students enrolled in vocational orientation courses who 
were counseled made the largest gain in proportion of optimal 
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choices from the beginning to the end of the year, whereas 
students enrolled in vocational orientation courses who did not 
receive counseling showed the greatest decrement in proportion 
of optimal choices from the beginning to the end of the year. 

7. The vocational orientation courses alone did not serve to 
offset the tendency of uncounsclcd students to make a greater 
proportion of poor choices at the end of one year's residence in 
college. However, when students in tlicse courses were 
counseled they showed a reduction in tlic proportion of poor 
choices by the end of the year. 

8. Vocational orientation served as a preparation for counsel- 
ing and tended to reduce the amount of time necessary for the 
resolution of vocational and educational problems. 

9. Although no other changes in measures of adjustment 
were observed, significant changes in social adjustment in a 
favorable direction resulted from a combination of counseling 
and course instruction in vocational orientation 

The general consistency of the trends of this investigation 
suggests the urgent need for a careful re-examination of pro- 
grams of vocational and educational guidance as they exist in 
both secondary schools and higher institutions. In many 
instances educators have felt that the mere process of teaching 
about occupations and allowing students to make judgments 
of their abilities through self-analysis serves as ample means 
to aid students in making appropriate vocational choices. On 
the other hand, some educators have given all of their attention 
to a careful and objective analysis of the individual with no 
time left for thoughtful consideration of occupational oppor- 
tunities in fields of work which are in accord with the abilities 
of the student. The trends of this study indicate that the 
adequacy of either method of guidance when used alone is 
open to serious question, Thoughtful attention to the objec- 
tive analysis of Individual aptitudes, abilities, interests, person- 
ality characteristics, and background, and the presentation of 
techniques for making careful choices, together with the 
presentation of vocational information and discussions of 
current occupational opportunities, promise the most successful) 
assistance to students in preparing for their work and entering) 
upon it. 
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AN OPTOMETRIC APTITUDE TEST 


NEIL D WARREN and A. A, CANFIELD 
Lfniversity of Southern California 

As a basis for the construction of an aptitude test for training 
in optometry, certain preliminary steps were necessary. A 
review of the literature in the fields of medicine and engineering 
revealed that the tests for training in medicine stressed the 
verbal achievement of the applicant, and that those in engineer- 
ing stressed the mathematical achievement. Inasmuch as 
optometry seems to combine studies related to both of these 
fields it was thought logical to make some measurement of 
these two factors in the aptitude test for optometry. In ad- 
dition to the information gained from a review of the literature 
in related fields, a job analysis was made on practicing op- 
tometrists in the city of Los Angeles. The ability to read dials 
and tables accurately and quickly and the ability to detect 
diseased conditions of the human eye seemed to be two im- 
portant components of their duties. A section of the test was 
devoted to an attempt to measure the applicant’s ability to 
read a graph quickly and accurately and to note minor varia- 
tions in detail. In addition to the review of the literature and 
the job analysis, a careful examination of the curriculum of 
study at an optometry school was nrade. The school ad- 
ministration pointed out those subjects that were of most 
importance to the student and special emphasis was given to 
them. The resulting test consisted of five parts and was to 
determine the following characteristics of the applicants; 

A. General level of scientific information. 

B. Scientific interest and attitude. 

C. Certain personality factors, such as attention to detail, 
accuracy of work, speed of work, etc. 

D. Amount of general information in fields other than, 
science. 

E. Mathematical ability 

183 
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F. Ability to do tine work which demands close attention 
and accurate perception. 

The primary purpose of the test was to determine whether 
or not prospective students would be able to assimilate the 
material offered in an optometry .school. It was not the pur- 
pose of the test to select those applicants who would do well 
in the practice of optometry or who wotdd demonstrate rigid 
professional ethics in the future,” except insofar as accomplish- 
ment in .school is related to profes.sional success. 

Besa-iplioji of ihc Test 

Part I, Figure Checking. — The first part of the test was 
composed of items of the familiar number checking type, 
designed to measure visual acuity, speed of perception, and 
persistent attention to detail. Four and one-half minutes were 
allowed to complete 40 items similar to the sample below; 

A. I47:ii()598. 147315689 

B. 55%(^&)(?D, , S%(&:()?D# 

The student was to mark A on his answer sheet if both sets of 
figures were the same, and B if they were different in any way. 

Part II. Personal lUstm-y — 'I'hc secontl part was composed 
of 50 items, dealing with the interest, attitudes, and personal 
history of the student. Eighteen minute.s were allowed for 
this part of the test. The interest items were designed to 
measure the relative amounts of scientific and persuasive inter- 
est. Sample items appear below: 

C. In general gla.s.ses are: 

a. attractive. 

b. baiely noticeable. 

c. unsightly. 

D. Of the following things, I would prefer to 

a. clean laboi atory apparatus. 

b. clerk in a store. 

c. do rough caipcntry. 

d. tune pianos. 

Part III. Mathematics. — F’orty mathematical problems 
were selected to cover algebra, trigonometry, and mathematical 
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reasoning. The students were allowed 45 minutes to solve 
them A sample item appears below; 

E A IS twice as old as B C is -i as old as B, 

Blow many times older than C is A? 

a. 2. 

b. 3 

c. 4 

d. 6 

e. 8 

IF- Verbal Reasoning and Vocabulary. — The fourth 
part of the test consisted of 80 items designed to measure 
general mental ability and scientific knowledge and 27 minutes 
were allowed for its completion General information items 
covering a wide range of topics, primaiily from the biological 
and physiological sciences, were used along with science vo- 
cabulary items and reasoning items. A sample item follows: 

F Of the following, which has the most highly developed 

neivous system? 

a Hydra 

b. Spiders 

c. Worms 

d. Beetles 

e. Amoeba 

Part V. Graph Reading. — ^The fifth part of the test was a 
complicated graph reading task consisting of 25 items. The 
student was required to find a point, interpolate its position 
and move it across a graph according to a set of instructions. 
This test was designed to measure attention to detail, thorough- 
ness of work, and persistence of attention. The students were 
given 20 minutes to complete all of the items. 

Procedure 

The test was given to two classes for validation purposes. 
The first study was made on the class of 1947, during their 
senior year in the school. Sixty-five students participated in 
this study, and constitute what will be referred to hereafter as 
Sample 1 . The second study was conducted in the early 
months of 1947 on the class of 1948, during their junior year 
in the school. Eighty-two students took the test in this second 
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Study. The 82 students who constituted the second validation 
sample will he referred to hereafter as Sample II. All of these 
students, tlie 65 in Sample I and the Hz in Sample II, had 
completed at least two years of colleue training elsewhere 
prior to their entrance into the T.n.s Angeles School of Op- 
tometry. 

Each section of tlic test had a time limit, the time allowed 
for Parts II, III, and IV heing long enough to permit most of 
the students to hnish those sections of the test. Parts I and 
V were speed tests, and hence the time-limit was set so short 
that only a very few would finish in the time allowed. Table 
I shows the mean score and the standard deviation of scores for 
both samples for each part of the test and for a total score, 


'I'AHLK 1 

The Mean ami Slatnlaul Devuitiu/t nf Tola I ami Pan Ten Semes 
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Part III( Mathem.uics) . 
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based on a summation of scores obtained on Parts I, III, IV, 
and V. 

The means and standard deviations reported for Part II 
of the test (Personal History, Interest, and Attitude items) 
were obtained in the following manner. No attempt was made 
to formulate a key on these items on a priori grounds. A key 
was developed by means of an item analysis made on the papers 
of the upper and lower ay per cent of the students in the first 
sample. This key was then applied to the total groups in both 
Samples I and II. Since some of the items had responses that 
were both favorable and unfavorable to success in school, 
some items were negatively weighted and hence it was possible 
for an examinee to obtain negative scoies on this section of the 
test 

The scores made on the various parts of the test, and a total 
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score based on a simple summation of scores on the sections of 
the test, excluding Part II, were then correlated with the stu- 
dents’ scholastic averages in school. Part II scores were not 
considered in deriving a total score because it was not believed 
statistically sound to use them. The fact that the key was 
prepared on some of the group and then applied to the total 
group would in itself insure spurious validity Also, the num- 
ber of items in Part II that had Phi’s of significance was very 
small and the part was scored more as a preliminary investi- 
gation than as a predictive index. 

The scliool used the letter system for grading and graded 
from A to F Since such grades as A - , C — , etc were reported, 
they were converted into numbers for ease of manipulation. 
The average grade made during the first year of study at the 
optometry school, (the junior year in college), was used as the 
criterion of success in training. The study was extended to 
include prediction of senior grades and a two-year average 
grade, but since the elimination or termination rate is so high 
the first year as contrasted with the second and last, the junior 
grades seemed to be an adequate and logical criterion to use in 
evaluating the effectiveness of the test. 

Results 

All correlations were computed by the Pearson product- 
moment method and the usual assumptions of the method 
seemed to be met. All results on all parts of the test seemed to 
indicate a normal distribution of scores, and linearity of re- 
gression was observed The small samples used in the study 
introduced fluctuations in the normality of distributions that 
could hardly be classed as error variance. In order to combine 
the two samples into one, and to make a combined study, their 
raw scores on the test and on the criterion were converted to 
C-scores. The reduction of the number of intervals allowed 
in grouping the data may have reduced the correlations slightly, 
but no correction is normally applied if the number of intervals 
is greater than ten. The correlations obtained between the 
students’ average junior grades and their scores on the various 
parts of the aptitude test are presented in Table a 
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Parts III, IV, and V of the test maintained their validities 
quite well from the first sample to the second; however, both 
Parts I and II had noticeable drops. The sudden drop in the 
validity of Part II is understandable in tcrm.s of the method 
by which the first correlation wa.s obtained, and indicates that 
the items selected for the fir.st study hud no validity when 
applied to another. Part T, the Number Checking section, 
dropped noticeably also. No change in the curriculum oc- 
curred between these two validations, and no explanation of 
this change of correlation can be offered other than a chance 
fluctuation produced small sample statistics. 


T.'VBLK 2 

Correlations between Average Junior Grades and Scoies on the Optomeirie Aptitude Test 
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The solution of a multiple correlation equation on the two 
sets of data reveals nrore markedly the drop in effectiveness of 
Part I of the- test The “b” weights, derived by the Doolittle 
method, for the various Parts for the two administrations were 
as follows; Part I had a “b” weight of 1734 for the first valida- 
tion data and a — .2132 for the .second, Part III had “b” weights 
for the same two samples of .1878 and .7478, Part IV was .3967 
and .3086, and Part V had "b" weights for the two samples of 
.2649 and .4048. The nature of the derivation of Beta weights, 
upon which the “b” weights are based, takes advantage of every 
minor variation in the regressions of tlie independent variables, 
and hence fluctuation would be expected to occur when com- 
puting the regression equation on groups of this size. No 
effort was made to compute “b" weights for Part 11 inasmuch 
as the validity coefficients themselves for that section of the 
test had no reliably significant meaning. 
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The reliability of the various parts of the test was computed 
on the basis of odd-even item scores and then was corrected by 
the Spearman-Brown prophecy formula. The reliabilities of 
the parts were in close agreement for the two administrations, 
being 94 and .94 for Part I, .8a and .84 for Part III, .83 and 
.84 for Part IV, and .95 and .99 for Part V. Since all parts of 
the test were timed, and Parts I and V were heavily weighted 
with the “speed” component, the reliabilities obtained by this 
method of computation are somewhat spurious However, it 
is believed that sufficient reliability has been demonstrated. 
The inter-correlation of the various parts was computed by the 
product-moment method and yielded results, based upon the 
combined samples, as presented in Table 3 


TABLE 3 

Iiiler-coi lelalioiis a/ (^tirtoiis Parts of the Optomeit it Aptitude Test 
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* Part I — Number Checking, Parr III — Mathematics, Part IV — Science Informa- 
tion, Part V — Graph Rending. 


The relatively high inter-correlation of the scores on Parts 
III (Mathematical Ability) and Part IV (General Science 
Information) is probably due to the inclusion in both sections 
of items that involve reasoning and a certain amount of verbal 
comprehension. The relatively high mter-correlation between 
Part IV and all the other parts of the test indicates that verbal 
ability or some reasoning factor must be present in all parts of 
the test. The generally higher correlations obtained with 
Part IV of the test and school grades indicates that this section 
deals with those factors most closely related to the attainment 
of satisfactory grades in optometric training. 

As a further check on the validity of the test, senior grades 
and an average two-year grade were obtained for all 65 of the 
students in Sample I. The predictive efficiency of the total 
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sc(A-e, based on a simple summation of scutes made on Parts 
I, Til, IV, and V of the test, maintains itself well, being .54 for 
senior grades and .60 for the two-year average grade, which of 
course includes the junior average. The validity for Junior 
grades for this sample was .6a, Part II (Biographical Informa- 
tion, Interest and Attitiule) of the test maintained its validity 
at about the same level, giving correlation, s of 56 for senior 
grade average and 61 lor the two-year scholastic average. Part 
III (Mathematics) t orrelated much knver with senior grades than 
junior, being only .ig for senior grades and .53 for the two year 
average grade. The other sections of tlie test did not vary 
in their validitie.s more than .06 This is well within the mar- 
gin of error. 

It would have been advisable to administer a standard in- 
telligence examination to botli groups of stiulenrs used in this 
study, and to correlate their scores on those standardized ex- 
aminations with their grades in school. This would have been 
a good check on the usefulness of the Oploutctric ^Iptitudc Test 
contrasted with that of a paper and pencil intelligence examina- 
tion. Because of the limited time avuilahlc for the study at 
the school, this procctlurc was not possible Ilowever, the 
Oplometric Aptitude Test and the Ilcnmon-Nelson were given 
to 45 students in Elementary Experimental I’sychology at the 
University of Soutlicrn California. The total score on the 
Optometric Aptitude Test and total score on the Plenmon- 
Nelson correlated .43. Since tlie Plenmon-Nclson is composed 
of tliree relatively unique types of items. Vocabulary, Arith- 
metic, and Reasoning, three scores were isolated on this test 
for each student. Correlation between various parts of the 
Optometric Aptitude Test and these ratlier artificial part scores 
on the Henmon-Nelson were computed. The verbal items 
from the Henmon-Nelson and Part TV of the Optometric Ap- 
titude Test correlated .65, the reasoning items and Part IV 
correlated .70. d’he number item,s and Part III of the Opto- 
metric Aptitude Test correlated .59, and Part IV and the total 
score on the Elen mon -Nelson correlated ,61. It appears that 
the Optometric Aptitude Test is more than an intelligence test, 
combining some of those elements with achievement measures 
and clerical ability measures not usually measured as such in in- 
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telligence examinatioiis. It is predicted by the authors that 
the Optometnc Aptitude 1 ‘est would have more validity for the 
selection of students in this field than standard paper and pen- 
cil intelligence examinations because of this wider coverage of 
ability and achievement 

Conclusions 

1 . The Optometnc Aptitude test has demonstrated a validity 
on two samples of optometry school students that is very near 
.60. Under the circumstances, involving the many sources of 
variance that influence scholastic achievement, this is thought 
to represent a fairly strong correlation 

2. A general science knowledge seems to be most closely 
related to success in this type of training compared to the other 
types of abilities and skills sampled by this test. 

3 Biographical Information, Interest, and Attitude items, 
as constructed and applied in this test do not have consistent 
validity in predicting school grades from sample to sample, 
but do maintain their predictive efficiency m predicting senior 
grades from junior grades. The high correlation between 
first- and second-year grades (.77) no doubt largely accounts 
for this 

4. Number Checking tests, such as the one included in the 
Optometric Aptitude Test, have validity for selecting optometry 
students, as do tests that Involve an ability to read graphs 
quickly and accurately, 

5. The ability to do mathematical problems involving reason- 
ing are indicative of future success in the study of optometry. 

The test seems to have sufficient validity to warrant its use 
by Optometry schools in student selection programs The 
authors suggest that it be used with other indices of student 
promise such as past school and social records, recommenda- 
tions by competent and ethical members of the profession, and 
personal interviews aimed at discovering the students’ attitude 
toward the profession 
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SELECTION AND EVALUATION OF 
WEST POINT CADETSi 

DONALD E. BAIER 
Personnel Research Section, A. G. 0. 

Introduction 

This paper will sketch the major work by the Personnel 
Research Section of The Adjutant General’s Office on the prob- 
lems of selecting and evaluating West Point cadets. It is de- 
sired to make clear at the outset that the studies to be discussed 
have required participation by various staff members over a 
number of years While the author shares general responsi- 
bility, it is primarily as a spokesman for some of the accomplish- 
ments of long-range institutionalized research exemplified by 
the West Point studies that he presents what follows. 

West Point ^alifying Examinations 

The first work done by the Personnel Research Section began 
in the spring of with the problem of selecting, from among 
West Point applicants with a record of successful college at- 
tendance, those who could be expected to fail scholastically at 
the Military Academy. In 1942. more than half of all of the 
applicants admitted to West Point qualified without exami- 
nation by presenting a certificate of satisfactory educational 
standing from an accredited university, college, or technical 
school A disproportionately large percentage of academic 
failures at the Academy came from this group, apparently be- 
cause of the difficulties inherent in the evaluation of college 
records. To meet the need for identification of potential fail- 
ures from this group and to provide a means of simplifying ex- 
amining procedures for other modes of gaining admission, the 
construction of a scholastic aptitude examination was under- 
taken. 

^ This paper presents the personal views of the author and does not necessarily rep- 
resent the official views of the Department of the Army 
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An analysis of the causes of academic failure indicated that 
Mathemetics, Knirlish and Foreign Language, in that order 
were the principal contributors to dismissal for scholastic fail- 
ure, most of the attrition occiiring iluring the first year. Ac- 
cordingly, tliree tests covering basic mathematical concepts, 
arithmetic leasoning, and language aptitude were constructed 
to form, with the Jruty Gcucral Classificadoti Test, a trial bat- 
tery of machine scorable tests. 

The Elementary Mathematics Test, a ;50-minute test of 75 
four-choice items, was constructed to get at mathematical in- 
genuity. The problems can be solved quickly if a simple alge- 
braic or computational equivalence is recognized, but require 
tedious computation if solved step by step. 
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The Arithvietic Reasoning Test, consisting of 54 four-choice 
items with a 30-minutc time limit, involved no unusual features. 

The Language Aptitude Test requires the translation of Eng- 
lish into an artificial language and vice versa. 7 ’he artificial 
language is described in a basic vocabulary and with rules for 
interchanging word forms It assumes the grammatical rules 
of English, Given with a 30-minute time limit, the test con- 
sists of 59 four-choice items 

Scores resulting from the application of this battery to 93a 
cadets accepted in 1940. into the class of 1945, were correlated 
with first-term grades in Mathematics, Spanish, English, Mili- 
tary Topography, and Tactics. These arc shown in Table i. 

After a consideration of the test inter-correlations and multi- 
ples it was decided that the most satisfactory battery would 
consist of the Eleinc 7 itary Mathematics Test and The Language 
Aptitude Test. This combination was titled the IFest Point 
Ratifying Examination i, hereafter referred to as WPQ-i . The 
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correlation between test scores and grades in succeeding years 
for the class of 1945 is shown in Table 2. 

The decrease in the r’s in succeeding years is attributed to 
the progressive selection of the population with a consequent 
elimination in the lower range of scores due to academic failure 
and separation from the academy. 

For WPQ-a applied to the class of 1946 {N = 826), the sub- 
test vs. course correlations are comparable to those shown in 
Table 2 The relation between total academic grade for the 

TABLE a 
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entering year and total WP^score is represented by an r of .54. 
For the graduating year it is 49 

That the most recent form of the West Point Ratifying Ex- 
amination WPQ-3 is even more predictive than earlier forms is 
indicated in Table 3 which presents a comparison of WPQ-i 
and 3 based on the class of 1947 which took both tests. The 
attenuation of the correlations in successive terms is again 
apparent. 

Data derived from previous studies, not reported herein, 
supported the conclusion that the total score on the W est Point 
Qualifying Examination predicts individual course grades as 
well as the appropriate sub-test score Data from the class of 
1947 on both WPQ-i and WPQ-3 lend further support to this 
conclusion. They are presented in Table 4. Because of the 
administrative convenience of using a single score, this charac- 
teristic of the West Point Qualifying Examination added to its 
substantial validity, shortness, objectivity, and ease of ad- 
ministration and scoring has made the test an efficient element 
in the selection program for West Point cadets. 
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Obviously, there arc other characteristics of the applicants 
for admission to West Point besides scliolastic aptitude which 
deserve careful consideration in making a decision as to their 
suitability. One of these is aptitude nr ability in the perform- 
ance of physical activities as distinct from the relatively static 
basis for evaluating physical capacity derived from the medical 
examination. The Personnel Research Section has been ap- 
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plying measurement techniques to this piroblent for more than 
a year. 

(Parenthetically, it may be of interest to know that while 
the prediction of scholastic success lias been under study since 
194Q,, other aspects of the problem of selecting and evaluating 
the cadets of the Military Academy have been the subject of a 
long-range researcli program only since the Spring of 1946. The 
research to be outlined hereafter was requested at that time by 
the Superintendent of the Academy, Major General Maxwell 
D. Taylor, and initiated by the Adjutant General’s Office im- 
mediately thereafter ) Up to the present time the following 
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has been accomplished The Wherry-Doolittle test-selection 
method lias been applied to some 19 physical proficiency tests 
including the Vertical Jump, Chins, Dodge Run, Sit-up speed, 
Softball throw, 300 yard Run, Dips, Standing Broad Jump, 
Rope climb. Vault, Burpee, Total Sit-Ups, Medicine Ball Put, 
Push-ups, 3 Broad Jumps, Flexion, Extensions, 50 yard Dash, 
and Endurance Index. Two criteria were employed for this 
purpose; one was grades in Physical Training, the other, an 
index of physical proficiency based on inter-cadet ratings. On 
the basis of these data, which will not be presented in detail 
because of the limited time available, a shortened, but efficient 
predictor battery consisting of 4 tests (Chins, Softball Throw, 
Standing Broad Jump, and Vault) yielding a shrunken multi- 
ple of .80 with course grades was employed for examining appli- 
cants in the spring of 1947. 

The biserial correlation between a ten-test predictor battery 
and overall success or failure at West Point proved to be .13 
although tetrachoric r’s at various points of cut indicated a 
higher value (.23) for the lower end of the distribution of scores. 

Factor analysis studies are in process aimed at identifying 
the principal factors involved in physical proficiency measure- 
ment in order that further improvement in test batteries may 
be effected. Exploratory studies are also being planned to de- 
termine if possible the relationship of physical performance as 
a cadet to later officer performance 

Other traits of great importance to cadet selection, if they 
can be successfully measured, are those related to adjustment 
at the academy and later success as a regular army officer. For 
this purpose an experimental, multiple response, biographical 
and personality inventory was administered to the applicants 
for admission to the class of 1951. A long-term follow-up is 
contemplated to collect criterion data indicative of adjustment. 

The construction of criteria for research purposes and the 
evaluation of cadet performance pose closely related problems. 
The principal research efforts in this area thus far have aimed 
at: 

I. Studying the inter-relations among three of the major ele- 
ments which determine final cadet standing. These are aca- 
demic grade, physical education grade, and aptitude for the 
service rating. The last named is a composite score derived 
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from inter-cadcc ratings uiul officer ratiniis by academic, tac- 
tical and pliysical traininu officers. 

1 . Detennininii tlie validity of the aptitutle for service rat- 
ings, as well as other predictors, against success as an army 
officer as inilicated by the Officers’ Kfliciency Rating. 

Typical ot inter-correlations aniomj the major elements in 
final cadet standing arc those for the graduating year, Class of 
1 946, shown in 'Fable 5. I’articular attention is tlireeted to the 
high con elation hetween final year standing and final year aca- 
demic grade. 
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a. Aj/t lor Servici; (tinid. Yc.ir) .41') .34 

a. Kin.il CompQ-.itc St.incling .1,3 .4(1 06 

4. Officer Efficiency R.nting 17 ..34 .06 

The relationship of the variables included in Table 5 to suc- 
cess as an army officer 18 months after graduating is shown in 
Table 6 for the Class of 1944 Officers' success is measured by 
score on the semi-annual efficiency report. The number of 
cases (403) IS less than the total commissioned at the time of 
graduation, by the number of officers for whom no semi-annual 
efficiency rating coukl be obtained. In evaluating the data pre- 
sented in Tables 5 and 6 the official weights assigned to the ele- 
ments should be borne in mind h'rom a total of laao points 
Academic receives 890 

Aptitude for Ser. 90 

Phys. Ed. Grade 15 

Actual weights do not deviate markedly from those assigned. 
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The most significant relation emerging is that between Apti- 
tude for Service and Efficiency Rating as an officer (r equals 34 
with values ranging from .51 for Infantry, through .32 for Tech- 
nical Service to .18 for the Air Forces). While it is clearly 
recognized that the objectives of the training at West Point are 
manifold and the data presented are limited by the short period 
of service as an officer which is covered, and the relatively small 
number of cases, the need to seriously consider increasing the 
weight accorded the Aptitude for Service Rating appears evi- 
dent Follow-up studies are continuing If they yield con- 
firmatory evidence, it is not unlikely that they may lead to 
modification in the weights presently assigned It has been 
repeatedly stated that the extremely heavy weight accorded 
academic standing in determining the General Order of Merit 
at Graduation (which incidentally determines position on the 
promotion list for army officers) is a reflection of limited con- 
fidence in the Aptitude for Service Rating. To the extent that 
evidence such as that presented here is accumulated, this atti- 
tude may be expected to change. Ultimately, of course, the 
assignment of relative weights must be somewhat arbitrary 
since agreement on a single criterion for selecting and evaluating 
army officers is not now in sight, 




ON THE ROLE OF DIRECTIVE AND NON-DIRECTIVE 
TECHNIQUES IN THE COUNSELING PROCESS 


JOHN M. BUTLER 
Veterans Administration 

It seems evident from the pro and con nature of the discus- 
sions in the literature on non-directive and directive' counseling 
that an all-or-none attitude is being taken by some writers with 
regard to these categories and to the techniques associated with 
them Therefore, an attempt will be made in this paper to 
describe the counseling process in terms of phases in which the 
application of non-directive and directive techniques may have 
maximum utility, 

In recent years, Professor Carl R. Rogers, his students, and 
his followers, in their exposition of the counseling process, have 
tended to define and to delimit this process m terms of social, 
emotional, and personal problems. At least the issues dis- 
cussed and the cases presented have revolved around these 
problems. For them, it appears, the main job of the counselor 
IS to recognize, accept, and reflect the emotionalized attitudes 
of the client in order that he may accept himself and effectuate a 
more adequate adjustment by choosing new goals which har- 
monize with his new-found recognition and acceptance of his 
spontaneous self. From his understanding of the duties per- 
formed by persons known as counselors, guidance counselors, 
vocational counselors, student personnel workers, etc , who are 
engaged m aiding individuals to adjust more adequately to their 
social, cultural, and economic environment, the writer is con- 
vinced that such a definition is somewhat restrictive. The 
majority of counselors known to him are (and should be) con- 
cerned with the total adjustment of the individual, whether it 
is social, emotional, educational, or vocational (economic). If 
this is acceptable, it follows that in practice the fractionation 

' The writer does not use the term "directive” m the sense in which it is described 
m chapter 5, leference 7., His use of the term will become evident Liter 
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of counseling into se[)ararL‘ functions .suoli as personal coun- 
seling, educational counseling, and vocational counseling is un- 
desiiablc. d’liis is implicitly recognized even in job descrip- 
tions of individuals restricted to "vocational counseling ” Kor 
exainjde, the luioklct, 'f'/ic rraunn^ of J'ocatioual Counselors^ 
issued by the Bureau of 'IVaining of the War Manpower Com- 
mission, lists among the functions ot the vocational counselor 
the foilin'. ing; 

In a peisonal llUL'r^•lcw obtains intnimation about the indi- 
Mtlual’s lioblnes, special intciests, peisonality tiaits, and atti- 
tudes, \Vhenevcr advisable to do so, also obtains information 
about linancial status, social backgiouiul, family or peisonal 
lesponsibilitie.s. 

Adniinisieis approiiriate aptitude, inteiest, peisonality, 
tiiule, aiulseluilastic uciiievement tests lo the individual eounse- 
lee and piepaies the semes for sucli tests 

It also states that as a ba.sic qualification the vocational 
counselor must; 

possess personal ch.uacreristics and skills to interview and 
maintain continuing relationships in whieli the eoopei .ition and 
confidence of the connsclee are obtained, and in which pci tinent 
facts and attitudes ate di.scovcietl and lelateii to a workable 
plan Must hav'e tlie ability to observe personal cliiir,ietei- 
isties 111 the interview and mieipiet tliem in teims of their 
significance m occupational adjustment. 

The purpose of the training unit outlined under the heading, 
Personality Ailjnstmcnts, is stated as follows' 

To give the vocational counselor an uiuleistaiuling of the 
origin of man’s behavim m primitive societv and m the mflu- 
ence.s of environmental and societal factors, the relation.ship 
between normal and abnormal behavior with a description of 
the functions of various agents dealing witli abnormal persons. 
The counselor sboultl be able to identify types of maladjust- 
ment and to lefer maiked personalit)' deviates to the proper 
speeialist.s 

The implication is clear that vocational counseling is con- 
cerned with the personality and with the possible personality 
disturbances of the counsclee as well as with matching men and 
jobs. Inasmuch as only marked personality deviates are to be 
referred to specialists it is not illogical to suppose that the vo- 



DIRECTIVE AND NON-DIRECTIVE TECHNIQUES 


203 


cational counselor is expected to use the data at hand concern- 
ing the personality of the client and to help him in the solution 
of his personal and emotional problems. The conclusion to be 
drawn, then, is not that the counselor should be a person who 
seeks only to enable an individual who has personality malad- 
justments to become more mature and effective, or to enable 
him to enter a suitable occupation, but one who in addition 
uses his skills and knowledge directly by facilitating the total 
adjustment of the individual. This description of what a coun- 
selor should do seems to jibe with the duties that many who 
have been given the title of counselor are expected to perform. 
Furthermore, it appears to be congruent with what we know 
about the interrelatedness of adjustment problems It is so 
well known as to be a commonplace that counselors are faced 
every day by individuals who claim to have pressing problems 
of educational, vocational, or occupational adjustment which 
are later found to be caused by, or at least closely intertwined 
with, personality disturbances 

If the counseling process is defined in terms of the total ad- 
justment of the individual, it seems evident that counseling as 
discussed by Rogers is but a phase in the total counseling proc- 
ess. The purpose of this phase is to facilitate the social and 
emotional adjustment of the client, without which he cannot 
face and constructively attack other problems posed by the 
culture of which he is a living part. This is equivalent to say- 
ing that culturally approved behavior will usually result from 
the application of non-directive counseling and it implies that 
a relatively constructive attack upon adjustment problems re- 
sulting from cultural demands will eventuate. The client’s 
emotional tensions, feelings of aggression, frustration, anxiety, 
etc., will have been released and will in the process of release 
have been transformed; he will have gained a new self-orien- 
tation and should, with acceptance of the self, be able better to 
re-orient himself to possible new goals indicated by reports of 
test results and information with regard to educational or vo- 
cational problems. 

This phase in which the clients are enabled to accept them- 
selves and which culminates in a constructive attack upon their 
problems of cultural adjustment will be referred to as the ad- 
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justive phase and the plvasc in whicli clients have shifted to a 
straight-forward problem-solving approach to the demands of 
their culture will be referred to as the distributive phase. The 
latter term i.s cho.scn because adjustment to the environment 
is conceived to be primarily a problem of the distribution of 
individuals in various socio-economic strata. 

It is to be noted that this formulation specifies first that the 
individual must be ready to use in a positive fashion the inform- 
ation the counselor can give him, including information con- 
cerning his interests, abilities, and aptitudes, and second, that 
this readiness on the part of the client is a function of his per- 
sonality adjustment. It implies that the interview situation is 
one in which, if necessary, the client first is enabled to accept 
himself as a person and recognize and face his pensonal prob- 
lems, then receives expert assistance in facing his particular 
world in terms of competitive cultural and economic demands, 
and finally learns something concerning the relation of his abili- 
ties, aptitudes and interests to these demands. 

The distributive phase of the counseling process is one in 
which the iclationship of the counselor to the client increasingly 
resembles that of the teacher to the student. I’he counselor 
may possess test results which will enable the client to assess 
his position in a scale of ability or abilities, achievement, and 
interests (as defined by interest tests). By virtue of his ex- 
perience and training the counselor may provide educational 
and occupational information which will be of great value to the 
client who is able to use such information constructively. For 
example, tlie university counselor may be confronted by 
a student who attended a small high school in which the average 
level of scholastic aptitude was low and in which competition 
was not keen The student desires to enter a medical school, 
His high-school record was good and he had high grades 
in mathematics, physics, chemistry, and German. However, 
the JCE Psychological Examination indicates that students 
with a score such as his have less than 3 chances in 10 of gradu- 
ating from the local medical school. Achievement tests indi- 
cate that his achievment in nrathematics, physics, chemistry, 
and German, is very low compared to that of freshman pre- 
medical students. The Strong Vocational Interest Blank shows 
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A ratings for certain business occupations, high occupational 
level, and high interest maturity. It also reveals C ratings for 
psychologist, engineer, physician, dentist, and physicist On 
the basis of his limited experience and successful competition 
thus far, the student believes the practice of medicine to be an 
attainable objective The counselor believes that the medical 
objective is unlikely to be realized because the client’s ability 
and achievement are low compared to those of pre-medical and 
medical students Furthermore, his interests as defined by the 
Strong Vocational Interest Blank are more like those of certain 
types of successful businessmen than they are like those of suc- 
cessful physicians. If this student is well adjusted personally 
and can react realistically to problems posed by his environ- 
ment, he should be able to make good use of the information 
which is presented in impersonal and non-technical terms by 
the counselor. He may, if his desire to practice medicine is 
strong enough, take a relatively light pre-medical program, 
take advantage of “how-to-study” classes, hire special tutors, 
and apply himself intensively to his work He may succeed 
or fail. He may consider other objectives as a result of the in- 
formation given to him by the counselor, and may discard medi- 
cal practice as an objective. In any event, he has benefited 
from the application of “directive” techniques by the counselor 
because he has learned something about his position with re- 
spect to his fellows. He has learned quickly through vicarious 
experience what must otherwise have been learned over a long 
period of time, and has been spared the possible traumatic 
effects of humiliating failure because he has become acquainted 
with the odds facing him. 

It appears that the techniques described by Rogers which 
seem to consist primarily of defining the interview situation in 
terms of client responsibility and of accepting and reflecting the 
attitudes and feelings of the client should, when possible, rou- 
tinely precede the distributive phase of counseling, which be- 
cause of its diagnostic aspects and the usual familiarity of the 
counselor with the fields of occupational and educational in- 
formation and tests, becomes increasingly “directive” as the 
phase nears completion. Needless to say, the use of “directive” 
techniques and the imparting of information to the client may 
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lead to unfortunate results in terms of opportunities lost to 
him if he is unahlc to evaluate oi to receive information in a 
positive and constructive fashion. In terms of oflice procedure 
this would mean an interview or interviews before the client 
takes any tests or before searching questions are asked. The 
counselor must, of cnur.se, be able tf) decide at what point in the 
process “diiective" techniques become appropriate. Wiiile this 
may seem to be a simple matter it makes great demands on his 
skill, since a primarily diagnostic attitude may dull his sensi- 
tivity to subtly expressed attitudes or feelings of the client with 
a consequent loss of rapport. Sucli a loss of rapport will result 
in a distortion of the counseling relationship and tlie conditions 
necessary for the effective application of non-directive coun- 
seling will no longer obtain. 

Clients whose basic problems arc emotional in nature often 
insist chat they be given tests and occupational or educational 
information in order to satisfy needs w’hich arc not directly re- 
lated to occupational or educational adjustment They say in 
effect ‘'Here I am, give me your tests; evaluate my personality, 
ability, and experience; set my goals and give me a push toward 
those goals.” In such cases it is obviotus that the adminis- 
tration of tc.sts and the giving of information may often 
he handled advantageously on a non-directive basis. Fot 
example, the available te.sts or types of tests may be described 
and the client may elect which he will take. Such a technique 
should result in le.ss rationalization and defensive beliavlor on 
the part of the client when the test results arc reported by the 
counselor The attitudes of the clients toward the tests and 
test results are the concern of the counselor; the information 
derived by the client is only incidental, since it is more than 
likely to be distorted considerably as a consequence of his needs 
To enter the distributive phase of counseling by forcing intel- 
lectual give and take on an unready client may result either in 
a lack of acceptance or in slavi.sh acceptance of the test results, 
it may allow him to depend upon the counselor for the solution 
of his problems, and, more than likely, may affect the test- 
taking process Itself. 

In the opinion of the writer, more fundamental issues have 
been overlooked because authoritarian counseling has not been 
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clearly differentiated from authoritative opinions. This may 
be a natural consequence of considering only those individuals 
wlio have primarily social-personal-emotional problems to be fit 
subjects for counseling. By defining counseling in terms of the 
total adjustment of the individual this difficulty can be avoided. 
For example, Rogers has described directive techniques as fol- 
lows : (a) Tlie counselor defines the problem in terms of diag- 
nostic or remedial procedures, (b) The counselor indicates the 
topic to be discussed and leaves its development to the client, 
(c) The counselor indicates the topic and delimits its develop- 
ment to confirmation, negation, or the supplying of specific 
items of information (d) The counselor identifies a problem, 
a source of difficulty or a condition needing correction, etc., 
through test interpretation, evaluative remarks, etc (e) The 
counselor expresses approval, disapproval, shock or other per- 
sonal reactions in regard to the client, (f) The counselor ex- 
plains, discusses, or gives information related to the problem 
or treatment, (g) The counselor proposes client-activity, di- 
rectly or through questioning techniques, or in response to the 
question of what to do (h) The counselor reassures the client, 
(i) The counselor interprets the test results but not as indi- 
cating a problem, source of difficulty, etc. (j) The counselor 
influences the making of a decision by marshaling and evalu- 
ating evidence and expressing personal opinions. It may be 
that these techniques are inappropriate when the counselor is 
confronted by clients with crippling personal problems. How- 
ever, techniques (a), (c), (e), (g), (h), and (j), are inappropriate 
in any counseling situation and in the opinion of the writer can 
only be characterized as bad counseling in any context To 
identify such techniques as characteristic of counselors em- 
ploying directive methods appears to be equivalent to saying 
that only non-directive techniques are appropriate. This may 
be true when counseling is restricted to clients with a relatively 
narrow range of adjustment problems. However, techniques 
(b), (d), (f), and (i) are not inappropriate in certain situations 
and, furthermore, there need be no conflict between these tech- 
niques and those listed by Rogers as more or less unique to the 
non-directive counselors, provided a proper sequence is followed 
in counseling with the client. In the writer’s opinion the term 
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“directive” shcnild have conntitaticms wliicli include such con 
cepts as direction un\;u-d a goal, authoritative information 
client responsibility, the prescatarion of po.ssihle alternatives 
c. It should not connote counselor tlireetions, .suggestion 
and “slanted" information based upon the desire of the coun- 
selor to have the client move in the ilirection of a counselot- 
•selecteii goal. 

Sninmary 

'I'hc counseling process as riefined hy Rttgers and his followers 
appeatvS to be almost identical with the concept of psycho- 
therapy. Counseling, however, may he defined in terms of the 
total adjustment of the individual. .Such a detinition is in- 
clusive of the concept of psychotherapy and aims at aiding the 
individual to face and to solve his adjustment prohlems what- 
ever may he their nature. If the latter type of definition is 
acceptable, (he counseling process is discerned as having two 
phases which have been called the "adjustive” and the “dis- 
tributive'’. In the adjustive phase the emphasis i.s upon the 
social, personal and emotional problems of the client; in the 
distributive phase the focus is upon his vocational occu- 
pational, and educational piroblcm.s. Non-directive techniques 
seem to be appropriate to the adjustive phase because con- 
structive impulses leading to the choice of appropriate goals, 
and hence, better adjustment, are distorted by emotionalized 
attitudes and feelings of guilt, fear, rejection, etc., which hinder 
the attainment and even the choice of such goals. Directive 
techniques, which imply the use of aiulioritativc judgment by 
the counselor based upon his training and background in the 
fields of psychology, tests and measurements, occupational in- 
formation, education, etc., are appropriate to the distributive 
phase of counseling. The distributive phase of counseling 
should not be entered until the growth processes inherent in 
the client result in independent aiul ntaiure judgments and 
readine.s.s to choose new goals or to abandon old ones. Non- 
directive and directive techniques are recommended for use in 
the adjustive and distributive phases tif the couiusellng process, 
respectively, because in the former emphasis is placed upon the 
emotional and social adjustment of the client and in the latter 
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emphasis is placed upon the intellectual and rational consider- 
ation by the client of various alternatives presented by the 
counselor in addition to the alternatives he may be considering 
on his own. 
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COUNSELING: ECLECTIC OR SYSTEMATIC? 

RAY H. BIXLER 
Minnesota Psychiatric Institute 

Following the appearance of Rogers' Counseling and 
Psychotherapy, numerous articles advocating eclecticism have 
appeared, largely in protest against the employment of a 
systematic point of view in interviewing In attempting to 
establish the merits of eclectic counseling, these writers have 
leaned heavily upon certain fundamental premises which are 
summarized below. 

1 The use of the appropriate technique at the appropriate 
moment promises more effective results than rigid adherence 
to any one method 

■2. Selection of the appropriate therapy from an “armament 
of therapies” by a skillful worker on the basis of diagnostic 
and case history techniques gives greater promise of success 
than systematic counseling, 

3. No one method is appropriate to the problems of all 
clients. 

Although these premises are undeniably sound, it is well to 
keep in mind the level at which we now deal with the problems 
of our clients. Diagnosis of emotional, vocational, and edu- 
cational problems is exceedingly crude. With a relative degree 
of certainty, diagnoses such as “alcoholic,” “vocational in- 
decision,” “behavior problem,” or “disturbed” can be made 
Diagnosis at the next level (anxiety neurosis, schizophrenia, 
etc.) becomes more difficult. Yet only the most naive coun- 
selors would assume that such symptomatic diagnostic labels 
determine the method of treatment to be employed, little less 
the technique for any given moment. When an attempt is 
made to determine causal relationships (“reading problem 
arising out of parental rejection,” etc ), the experienced coun- 
selor is frequently taxed beyond the limit of his skills. It 
should be remembered that even at this level of diagnosis the 
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Lounsclor Ikus ikj crifL-ria liy which .selection of the appropriaie 
technique at the uppropt late moment i.s fea.sihle. (When 
etiology can be established, it is often jKissible, however, to 
achieve more efficient .selection of the appropriate gross method 
such as environmental manipulatum, versus euun.seling.) 

In tlic light of f)ur present iliagnostic skills, it would seem 
safe to .state that we have no criteria hir the .selection of tech- 
niques at any one point in tlierapy, nor do we even have cri- 
teria by which we can determine whicli of numerou.s interview 
therapies is most effeeti)m with any one client. 

The use of an "armament of therapies” raises one additional 
question for those schooled in any systematic approach, The 
systematist has found that achieving a high degree of skill in 
the one method he has studied under suiwrvislon is quite a 
ta.sk, He is openly apalled at the mere tlumght of learning to 
be facile as an analyst at nine o’clock, a client-centered coun- 
selor at ten, and an Adlerian at eleven, not to mention the 
afternoon with Williamson, Homey, Allen, and Hartwell. 

The third premise is undoubtedly af'propriatc. Although 
the .systematist verbalizes the limitafion.s of his method, all too 
frequently he denies thorn in practice. 

With oui present lack of understanding, clinical experience 
and observation justify certain tentative conclusion.s: 

I. Regardless of the method of counseling employed, success 
in treatment beais a close relationship to (he problem con- 
fronting the client. Severe rejection or indulgence pose the 
most difficult problems of therapy in parent-child relation- 
ships, regardless of the tlierapeulic method. Hysterical 
personalities usually react favorably to many methods of 
treatment, while alcoholic and homosexual personalities resist 
the same therapies One possible interpretation; It is the 
client rather than the type of therapy that determines treat- 
ment success. 

a. There is a lack of evidence to Indicate the superiority of 
any one metliocl. 

3, Therapy is largely a non-intellectual process, The 
resistant child who sits passively through the therapeutic 
period time after time, the student who is allowed to refuse 
therapy, and the client who "catharts” get better — all too 
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frequently for any of our pet theories. The writer' now has a 
passive delinquent (in a very resistant way) who reads a maga- 
zine during the interview period. He is coming in under court 
pressure When environmental changes were suggested to 
him, he accepted on the condition that he could continue our 
contacts! He is making constant improvement Discussing 
these experiences with other therapists, the writer finds that 
they can be multiplied many times. 

The writer believes the most appropriate interpretation of 
this data must place the client’s personality and the counselor’s 
attitude above methodology. It appears that what the coun- 
selor says pales in significance beside how he says it; that is, 
how he feels toward the client. 

This philosophy is not easily translated into counseling 
action. Furthermore, the concept has little value in super- 
vised training One has onljr to imagine how confused student 
therapists would be if they were told, “The only thing you have 
to do is accept your clients ’’ Acceptance must be imple- 
mented by techniques which are meaningful to the student 
therapist and facilitate his comfort with the role of accepting 
his clients if we are to make constructive strides in imparting 
our knowledge and understanding to him 

Rogers (3, Chapter III) has attempted to put this process 
into words. The written word transmits only the intellectual 
aspects of any technique, Snyder (4) has pointed out that 
rigid adherence to verbal acceptance without feelings of ac- 
ceptance results in poor therapeutic gains 

In light of our present understanding, this does not offer 
any solution to the choice of methods. The eclectic can easily 
justify his approach by saying: 

When we know so little shouldn’t we use every technique 
• and resource possible? 

The nondirectivists can parry with . 

Since we know so little and what we know tends to indicate 
that the key lies in the client, why not give the counselor the 
security of one facile approach which minimizes the danger of 
traumatizing the client and frees the counselor to be sympa- 
thetic and understanding? Or must the counselor through 
continual selection of this or that method which he hopes is 
appropriate remain on a cold analytical plane? 
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Akhouiih such (H«t|>uurine of claims and counterclaims based 
on feeling rather than eviiknce might appear ridiculous to the 
casual ohserver. it is prtdnihiy a necessary prelude t'< progress,' 
By following our own iicnts under the intense stimulation 
eugeiuiered hy strong feeling, we hasten the exploration so 
necessary to the refincmenf (»f therapeutic procedures, 
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AN APPLICATION OF GUTTMAN’S NEW SCALING 
TECPINIQUES TO AN ATTITUDE QUESTIONNAIRE 


KENNETH E. CLARK and PHILIP H. KRIEDT 
University of Minnesota 


Dr. Louis Guttman and his colleagues have developed a 
method of scale analysis which claims to permit the measure- 
ment of attitudes by the use of a small number of questions, 
and to provide ready checks to determine whether these ques- 
tions belong together as different facets of the same issue.' 
Significant features of this new method are. a new set of criteria 
for determining whether items of an opinion or attitude ques- 
tionnaire can be considered to constitute a unidimensional 
scale for which a single total score is meaningful, a technique 
for re-scoring items so that they will meet the requirements 
of this criterion more successfully, and, methods for determin- 
ing a “zero-point,” so that the population may be divided more 
readily into pro’s and con’s. That Guttman sees the possi- 
bilities for wide-spread applications of these methods is indi- 
cated by the following quotation: "This approach has wide 
ramifications not only for attitude and opinion research, but 
for many other fields like market research, mental testing, and 
elsewhere where it is desired to quantify qualitative data.”^ 
This report concerns the application of Guttman’s techniques 
to a conventional attitude scale. A twenty-two item scale 
constructed by Rundquist and Sletto to measure the economic 
liberalism-conservatism continuum was selected.® This partic- 
ular scale was chosen not because it promised to be unidi- 
mensional in character, but because it had been subjected to 
an accepted method of attitude scale refinement, namely, the 


' Guttman, Louis “The Coinell Technique for Scale and Intensity Analysis ” 
Educational and Psycholooioal Measurement, VII (1947), 247-280. 

“ Guttman, Louis, op cit,, p 247 . „ , , t, ... 

“ Rundquist, Edward Alfred and Sletto, Raymond Franklin Personahty in the 
Depreuton' a Study in the Measurement of Attitudes. Minneapolis University ot 
Minnesota Press, 1936 
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likert ttchnique. The present stiuiy limits itself to Guttman 
techniques of content analysis, ainl ncjticcts the techniques of 
intensity analysis. 

According to Guttinan's criterion for unidirnensionality, 
which he calls reproducibility, a scale has perfect reproduci- 
bility if fr<Jtn a person’s rank on the total .scale it is possible to 
reproduce hi.s re.sponse to each item in the .scale. Consider a 
scale of items eacli of which is setired two. one, or zero, perhaps 
for re.sp(m.sc.s "Agree." ‘T'ndecided,’’ and "Disagree." (The 
same method can be used for items having any number of 
re.sponse categories.) The reproducibility of any single item 
is determined by preparing a tabic in which respondents are 
ranked according to their tf»tal sct»re.s, and by recording for 
each his response to the item in quc.stion. If an item has 
perfect reproducibility, each person scoring two on that item 
will have a higher total .score than any per.st)n scoring one or 
zero, and each person .scoring one on that item svill have a 
higher total .score than any person .scoring zero. .Since per- 
fection i.s rarely auained, the degree of reproducibility is 
ordinarily calculated. 

The prepared table of respondents is scrutinized, and, for 
each item, two cutting points are arbitrarily selected. When 
properly placed, these points tlivide the li.st of respondents into 
threescctions so m to ntaximize the percentage of two-responses 
' in the top section, to maximize the percentage of one-responses 
in the middle .section, and to maximize the percentage of zeto- 
responses in the bottom section. The percentage of responses 
to each item which do fall properly into the three sections set 
off by these two cutting points is that item’s per cent repro- 
ducibility. Guttman seems to apply the term reproducibility 
more to an entire .scale, however, than to an individual item, 
The reproducibility of a scale is the mean of its individual item 
reproducibilities. A scale is considered to have satisfactory 
unidirnensionality if it has a reproducibility of 90 per cent 
or more. 

The reproducibility of a scale i.s improved by increasing tlie 
reproducibility of individual items. The Guttman method 
does not improve a scale solely by eliminating j’oor items and 
retaining good ones, as do most methods of scale refinement,, 
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but modifies the scoring of items by combining response cate- 
gories which overlap: that is, response categories which are 
selected in nearly equal proportions by persons with differing 
scores on the total scale Re-scormg would be needed, for 
instance, if examination of the table in which the respondents 
are ranked by total score shows that the two-responses for an 
item all come first, but the one- and zero-responses intermingle 
The two-responses should still be scored as two, but the one- 
and zero-responses should be combined, and all be scored as 
one’s or zero’s. After necessary re-scoring has been accom- 
plished for all items, new total scores are computed, respondents 
are re-ranked, and a new per cent reproducibility figure for the 
scale is determined. 

This technique of scale analysis was applied by the writers 
to data secured by administering the Rundquist-Sletto Scale of 
Economic Conservatism to 306 students enrolled in a psychology 
laboratory course at the University of Minnesota. Since the 
writers wished to determine the extent to w^hich chance factors 
influence per cent reproducibilities of items, the completed 
questionnaires were divided randomly into two samples: 
Group A, those students sitting in even-numbered seats, and 
Group B, those in odd-numbered seats. Each writer worked 
independently applying the Guttman methods to one of these 
two sample groups. 

Difficulties were encountered almost immediately upon 
beginning the analysis of these data. In the first place, the 
writers found the process of assigning cutting points for com- 
puting reproducibilities to be difficult and arbitrary Gutt- 
man’s descriptions of methods for computing reproducibilities 
were found to be inadequate for insuring that each of the writers 
would use the same criteria for determining these points. 
While each of several sets of cutting points would give equal 
per cent reproducibilities, some sets would hold out greater 
promise than otliers for improved reproducibility when item 
responses were combined, In the second place, little agree- 
ment was observed between the two samples as to those items 
which had high reproducibility. Discrepancies were observed 
in spite of the fact that the distributions of item responses 
for the two samples were quite similar. 
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Havina (distTvcd Imv an*i uiisatislactftrj' rcpraciiicifiilities for 
the scale for hofh samples, each wnrcr atracked the problem 
(if comhininu resptnse eareironcs Mt as m increase reproduci- 
hiliries. 'I’he necessity hm hillnwini.' a staiulard procedure for 
the improvement of reprodncihility without introducing ex- 
traneous factors led the writers to diclmtninme all response 
categories. It was agreed that each wouhl dichotomize by 
comluninp and 4 rcsjamscs .and iiy combining z- and i- 
resp()nse.s. The ,prcspoiiscs were to he thrown with the 5,4 or 
1 ,z group .so as to minimize the number of misplacements, 
thereby maximizing the reproducibility of the item. It should 
be noted at this point that, hael the writers dichotomized their 
response categories to separate either the i- or 5'response for 
one category, and to combine the four remaining re-sponses for 
the other category, it would have been pmssilde to obtain a 
reproducibility of yb per cent for hotli samples even if all 
iteni.s were completely unrelated to each other. This is true 
because of the way in which the obtained reproducibility figure 
depends upon the di.stribution of response.s. .•\.s Guttman 
notc.s, . . reproducibility of an item can never he less than the 
large.st frctpiency of its categories. . . ."■* Thus, if an item can 
be dichotomized .so that 90 [kt cent of the responstm fall in one 
category, the item will necessarily have a reproducibility of at 
least go per cent. 

Guttman ofFer.s no satisfactory .solution to this problem of 
“spurloim reproducibility." He ,say.s; ".-Xn empirical rule for 
judging the spuriousness of .scale rejmoducibility has been 
adopted to be the following; no category sliould have more 
error in it than non-errcir."“ This seems to be an arbitrary 
and off-hand attempt to .solve what is one of the fundamental 
weaknesses of the Guttman scaling scliemc. 

When the re.sults of dichotomizatkm of categories were 
compared for the two samples, it was found that in only six 
out of the twenty-two items did the writers agree in the place- 
ment of the 3-rc8pon.se. I'ileven agreements is the average 
that would have been expected by chance. K.nch sample was 
therefore handled separately, total scores were re-computed, 

* Guttman, 1-ouls, op cit., p. srto. 

‘ Guttman, l^uis, op cil., p. aftt. 
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individuals re-ranked according to this total score, and re- 
producibilities re-computed. Original and new item and scale 
reproducibilities are presented in Table i Combining all 

TABLE I 


Per cent ReproducibthUes Jor Individual Items, and for the Total Scale, With Five and 
Two Category Responses, Rundquist-Sletto Economic Conservatism Scale 


Item 

Niimber 

5 -Category Responses 

1 

2 -CEitegory Responses 

Group A 

Group B 

Group A 

Group B 

1 

64% 

58% 

95% 


2 

49 

45 

84 

75 

3 

41 

44 

65 

81 

4 

57 

S' 

70 

74 

s 

61 

41 

81 

81 

6 


65 

72 

90 

7 

6a 

51 

81 

78 

3 


45 

75 

71 

9 

5^ 

45 

77 

70 

to 

54 

45 

78 

85 

ir 

44 

45 

66 

73 

la 

62 

55 

87 

82 

13 

57 

50 

72 

79 

14 


41 

82 

78 

IS 

62 

58 

70 

85 

16 

60 

52 

89 

84 

17 


47 

79 

84 

18 

68 

55 

85 

84 

19 

51 

50 

81 

88 

20 

58 

54 

79 

83 

21 

51 

45 

83 

76 

22 1 

62 

55 

76 

83 

Total Scale 

56% 

50% 

19 % 

80% 

N . 

149 

158 

I49 

158 


response categories into dichotomies has increased reproduci- 
bility for the scale from 56 per cent to 79 per cent for Group 
A, and from 50 per cent to 80 per cent for Group B. 

Since the lowest possible reproducibility for a scale consisting 
of five category responses is 10 per cent, and for a scale of 
dichotomized items, is 50 per cent, it is possible that the ob- 
served increase in reproducibility merely reflects the increase 
in minimum values. (Actual minimum values for Group A 
were 4a per cent for the 5-category scale and 68 per cent for 
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the 2-catcgory .scale; for (^rouji B these values were 42 per 
cent and 64 per cent). 

These new scale reprcKlucibilities still do nor meet Guttman’s 
criterion for satisfactory unidimcnsionality witli cither of the 
two .samples. One mu.sr cttncludc. on the hasi.s of the analysis 
by Gutfinan'.s methods, that this scale does not pcjssess unidi- 
mcn.sionality. and that, therefore, it shonki lurt be used to 
obtain a .single score which wouKl be u.sctl to reflect an in- 
dividual’.s position on a liberahsnvconservatism continuum, 
In fact, rme may interpret (njttnian's writing.s tf» indicate that 
the very cxi.stence of .such .1 continuum has been denied. 

T.AHI.K 1 

OJJ-Esen Rtliokihlits «/ tht Hf/r,re ami Ajttr Rt-Scorinr hi 

Vie '■/ Gunman's 


' 


KcliaRility 

1 

1 

(irriujl A 

(itoup B 

Original Scute ... 

■ R? 

i -87 

Scute Modified by Diehowmtiting at! Ke- , 


11 

spoitHC Categories . . 1 


^ .88 

r 

Mr/ 

; i ;8 


* The Spciirman-nrowM I’roi'hccy Formula ha'i Iwm ai'plied. 

This concIiLsicjn i.s reached by Guttman’.s methods in spite 
of the fact that this scale, whether in its original form, or modi- 
fied into dichotomous response categories, tloes possess quite 
high internal consistency as measured hy odd-even reliability. 
These value.s arc presented in Table 2, These reliabilities 
approximate the ,^5 and .8a values reported by Rundquist 
and Sletto.® Information regarding the internal validity 
values of individual dichotomized items is presented in Tablej. 
Item validities were computed using Flanagan's tabie.^ These 
values are estimates of the product moment correlation 
coefficient obtained using the upper and lower 27 per cent of 
the sample. In contrast to the item reproducibilities presented ^ 

• Kundquist, Edwnrd Alfred and Stct(o» Kuymond Frftnklin. PerSGtialU^ in th 
peprmwn: J in the Me&iuwntni of JuHuties, Minneapolb; University of 
Minnesota Press, 193(1. 

'' Fianngfin, John C., "Item Analysis by Te.sc Scoring Machine Graphic IteW 
Counter," of the Ejiucotiomi Heseorch Forkvii New York. International 

Business Machines Corporation, pp. 
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in Table i, these values appear to be very satisfactory. One 
must conclude either that the Guttman scaling methods do 
not apply to scales of this type or that Guttman’s techniques 
do uncover weaknesses which are obscured when usual methods 
of scale analysis are used 


TABLE 3 

Hem Internal Falidilies Computed iy Flanagan's Method For Rundqmst-Sletto Seale 
When Responses are Dichotomized by Use of Guttman’ s Methods 


Item 

Niimber 

Item Validities 

Group A 

Group B 

I 

.67 

77 

2 

.66 

63 

3 

.40 

42 

4 

•93 

59 

i 

.80 

71 

6 


,80 

7 

60 

.68 

8 

•91 

•47 

9 

74 

•47 

10 

• 90 

.70 

n 

40 

52 

12 

•94 

74 

13 

•47 

72 

U 

.72 


15 

•97 

82 

16 

•93 

•63 

17 

63 

76 

18 

46 

48 

19 

•99 

59 

ao 

•71 

73 

21 

.6g 

.60 

22 

72 

.6a 

Median Item Validity ... . 

98 

65 

N 

149 

158 


Although the following criticisms are based on a single ap- 
plication of the Guttman technique, the writers feel that several 
basic flaws in the method are apparent and that an attitude of 
suspicion towards the general application of the technique is 
justified. The following specific comments are offered. 

I. The concept of reproducibility, and the methods used in 
computing reproducibility, seem like a throwback to the crudi- 
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ties of early item analysis metlimls. Emphasis is placed upon 
counting: cutting points are not precisely deterniinccl. Chance 
factors play a heavy role in determining the value of the ob- 
tained statistic, no estimate of the standard error of a repro- 
ducibility value is provided. Although Cjiittman implies that 
it is relatively easy to determine how to combine categories, 
tile writers found it quite diflicult with the present data, and 
often disagreed with each otlier. 

2. I'he writers' purpose in making separate analyses of two 
different samples was to estimate the .stability of the statistic, 
per cent reproducibility. Guttman sratc.s tliat “about loo 
persons will usually constitute an adequate sample of the 
population to test the hypothesis of scalability.’''* In the 
present study two samples of about i <;o jicrsons each were used. 
Idttle agreement was found between the two samples when 
item rcfiroducibilities were compared. 

It is difficult to appraise the stability of the statistic, per 
cent reproducibility, since to the writers’ knowledge it can be 
estimated only empirically. Comparison of h'lanagan item 
validities and per cent reproducibility for this study leads the 
authors to conclude that Guttman’s imlex of internal consist- 
ency is no more stable than usual indices of item validity. 
Flanagan® implies tliat a sample of 500 is required for reason- 
able accuracy using his method. It appears that Guttman is 
not justified in a,ssuming that too persons constitute an ade- 
quate sample to test his hypothesis of scalability. 

3. Guttman’s selection of go per cent reproducibility as the 
criterion of scale unidimcnsionaliry is not only arbitrary, but 
extremely misleading. 'I’he number of response categories 
used for scoring each item has a direct effect upon reproduci- 
bility. As the number of response categories decreases, the 
amount of possible error automatically decreases. Thus the 
Guttman method places a premium on the scoring of responses 
dichotomously. In addition, scale reproducibilty is closely 
related to the “difficulty,” or response distribution, of an item. 

•Guttman, Louis. "The Cornell Tcchiiiciiic for Scale and Intensit)' Analysis.” 
EmicynoNAi, and PsycHoioracAi. sfEAHtRRMENT, VJl (1^47)1 247”_28o. p. 249. 

•Klnnagan, John C. "Item Analysis by Test Scoring Machine Graphic Item 
Counter" Proceedings gj the Ediicaltonal Restarch Fortnn. New York. International 
Business Machine Corporation, 1940. p. 91. 



GUn'MAN’s NKW SCALING TECHNIQUES 


223 

A scale having very high reproducibility may be easily con- 
structed by including only very popular and very unpopular 
statements. In otlier words, Guttman’s criterion, when used 
alone, encourages two item characteristics which are not gener- 
ally considered desirable. 

4. Guttman’s method for estimating reproducibility is so 
designed as to maximize the statistic obtained, capitalizing on 
chance error It seems to the writers that a measure of internal 
consistency should be neither an over- nor under-estimate, 
but rather a “best estimate” of the relationship between an 
item and the total scale. 

5. When Guttman talks of reproducibility, he is talking, 
apparently, of internal consistency. Although he has dis- 
cussed some of the theoretical implications of reliability in a 
recent article'" he has not yet presented any practical analysis 
or empirical evidence of the ways in which his methods supple- 
ment, replace, or otherwise relate to the usual methods for 
scale analysis. In this study, little relationship was observed 
between Guttman’s measure of the relation of an item to a 
total score, and Flanagan’s index of correlation between an 
item and the total score. Also, application of Guttman’s 
scaling method had no apparent effect on odd-even reliability 

Guttman’s methods of scale analysis may prove to be of 
value in the fields of opinion and attitude research. It would 
appear, however, that these methods are still very crude and 
are not yet ready for widespread use The present study 
indicates that in areas of general attitude measurement, at 
least, serious limitations may exist. Further research is 
needed to determine the circumstances, if any, under which 
the use of these methods is warranted. 


Guttman, Louis. "On Festinger's Evaluation 0/ Scale Analysis.” Psychological 
BuIltlw, xLiV (1947), 451-465. 




COMPARISONS OF SELF-RATING, PEER-RATINGS 
AND EXPERT’S-RATINGS OF PERSONALITY 
ADJUSTMENT 

MARGARET G. POWELL 
Children’s Services 

A client’s complaints usually form the starting point for 
counseling, and his feelings of adjustment are frequently used 
as a measure of progress during counseling. Therefore, it is 
important to determine the validity of his statements. Are 
they influenced by a lack of self-insight or distorted by defense 
mechanisms ? Inaccurate or incorrect clues given by the client 
may result in a loss of valuable time and effort, and may pos- 
sibly end in an incorrect diagnosis. It seems important to 
evaluate a person’s insight into his own personality adjustment 
by checking against other measures. 

One such measure is the counselor’s observations. But he 
does not have extensive opportunities to observe overt symp- 
toms of maladjustment since he sees the client only in an ' 
interview situation. Symptoms of personality maladjustment 
are usually too closely interwoven into the person’s daily ex- 
periences and his entire social milieu to be adequately observed 
in one, two, or three sessions in a limited counseling situation. 
The counselor usually, therefore, questions the client in an 
attempt to gain information to supplement his own limited 
observations However, the counselor may feel that the 
client’s statements and his own observations are also inadequate 
and so seeks the observations of additional judges, i.e., the 
client’s associates, co-workers, teachers, friends, or employer. 

What is the relationship between information gained from 
these different sources? Is the picture a client may have of 
himself the same as that held by the counselor or other expert 
judge? Furthermore, how much agreement is there between 
his conception of his own personality and the opinion about 
him which is held by his friends? 
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It Is it common practice to use tmly one ctr two measures of 
adjuvStment in making a <liagnosis. Perluvps most frequently 
the counselor uses his own rthservafions aiul the self-rating of a 
client to make a diagnosis. Similarly, research into the out- 
come of therapy is commonly determined hy tlie use of one or 
two measures. A case is amstdered as successful following 
therapy because the client considers himself as hetler adjusted, 
or hecau.se the coun.selor considers him a,s herter adjusted, but 
rarely are sulditisma! measures used. 

I'he purposes of this study arc, therefore: (i) to determine 
the relationship between self-insight into adjustment and die 
“real” nature of the person as shown from rating.s of peers and 
of an expert and (a) to determine the relationship between 
three different approaches t<i the measurement of adjustment, 
i.e., a self-rating, a peer-rating, and an expert’s rating. 

The field of personality testing has attracted many inves- 
tigations. Ellis' has rcvicwetl many of these studies which 
attempt to validate .self-rating questionnaires. Although some 
of these studies were similar in purjai.se to the present study, 
they investigate only the amount of self-insight individuals 
have into their adjustment as compared to ratingvS by other 
judges. Rating, s hy more than one class or type of judge 
were not included in the.se studies. Either the probleni was not 
considered, or else it was assumed that a person's adjustment 
as rated by a judge seeing the subject in one light would be the 
same as that by a judge seeing the suliject under other condi- 
tions. Such an assumption docs not seem to be justified by 
ordinary observations. The purpose of this study, then, was 
to investigate the relationship between three measures of ad- 
justment, i.e., rating by self, by the subject’s peers, and by 
their dormitory counselors. 

Methods 0/ Investigation 

This study was made in a large dormitory which housed ap- 
proximately five hundred and sixty girls at Ohio State Uni- 
versity in tiie Spring of 1946. E'or purposes of organization 

1 EH'is, Albert. “The Validity of PetsonoKty Inventories." PsyMosical Bulltlin, 
XLIII (1()46), 381-440. 
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these girls were arranged in corridor groups determined by the 
location of their rooms on the different floors. 

Since the large number of girls m the building made it imprac- 
tical to include all of them in this study, eight corridors totaling 
one hundred and forty girls were selected as a sampling. These 
eight groups were selected on the basis of three criteria; (1) 
The corridors should be large and of the same size in order to 
give more reliable and comparable peer-rating scores. (2) 
Each expert, i.e., the four dormitory counselors, included in the 
study should have only two corridors to rate, so that each 
should rate a small enough number for all to be carefully done. 
(3) The corridors selected should have none, or but few, girls 
who were new since the beginning of the school year so that the 
peer and expert ratings should not be influenced by a lack of 
knowledge about any girl. 

T^esting Materials. — In order to gain a self-rating score or an 
indication of how well adjusted or poorly adjusted the girls 
believed themselves to be, the Bernreuter Bersonahty Inventory 
was used This inventory is representative of the self-rating 
devices used in counseling practice. While the test does not 
directly ask for self-evaluation in terms of others, the subject 
usually answers in terms of his feelings in comparison to what 
he thinks others feel, and the test percentile, which is a group 
comparison, is frequently used as a measure of the degree of 
adjustment. 

Two scales of the Bernreuter Personality Inventory were used: 
The Bi-N, a measure of neurotic tendency; and the Fz-S, a 
measure of sociability. These two scales measure two aspects 
of self-feeling and, because of the substantial correlations which 
have been found to exist between them and the other Bern- 
reuter scales^ these two scales are representative of the test as 
a whole. 

On the staff of the dormitory were four Assistant Head 
Residents who were chosen as the experts for purposes of this 
study. These Assistant Head Residents cared for the girls 
on their corridors during illness, supervising the girls in all of 
the regulations of the hall, counseling and guiding them in 

“ Bernreuter, Robert G. Manual for the Personahty Imentory Stanford Uni- 
versity. Stanford University Press, 1935 
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whatever way appeared advisable, and estalvlishing a friendly 
relationship which would encourage their confidence. This 
study was made iluring the Spring (Quarter of the .school year 
so that these crtunselors hatl been responsible for the girls on 
their coiridors for several months. 

d'he “expert’s rating" was obtained by a.sking the counselor 
in charge of a corridor to rate the degree t»f adjustment for each 
of her girls on a rating scale, 'riicse expert.s were in.structed 
in the use of the s‘calc and warned of tlie dangers of the “halo” 
effect. 

The expert’s rating .scale was constructed as follows: On the 
ba.sis of a thorough review of the literature, items were selected 
which would sample all of cite major asi>ects of adjustment 
and differentiate between genera! adjustment and maladjust- 
ment. The final scale was composed of seven traits on which 
each girl was to he rated. Opposite each item, a rating con- 
tinuum was set up so that the counselor could mark an “X” 
on the graphic scale to descrihe the degree of die girl’s behavior 
on thi.s trait. 

These rating .scale.s were scoreil by .securing a numerical 
score for each of the seven traits rated accortling to the dot on 
which the “X" was marked, each dot corresjumding to one 
point. The score on each trait might range froin o to 40. The 
sum of these seven .scores became the score recorded for each 
girl. 

P To establish the reliability of dm .scale, three other coun- 
selors were each asked to rate one of their corridors of girls 
on the scale. After a period of four w'eeks they .again rated the 
same girls on this scale, Comparisons of the two ratings 
showed a median reliability coefficient of ,76 for the three groups 
.^computed by the rank difference method. 

Through day-by-day contacts the girls on the same corridor 
became well acquainted widi each other and it appeared 
evident that the.se girls living, w'orking, and spending leisure 
time together should be capable of judging the personality ad^ 
justments of one another. 

Two different measuring instruments were used to obtain 
peer-rating; a “Guess Who” test to measure general adjust- 
ment and a sociometry test to measure popularity. The 
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“Guess Who” test was constracted by re-stating the items in- 
cluded in the expert’s rating scale. Of the twenty items in- 
cluded on this test, ten are associated with a well-adjusted 
person and the other ten with a poorly-adjusted person. On 
this test the girls were to consider their corridors as a whole 
and were to insert in each blank the name of the person on their 
corridors whom they thought most nearly fitted the descrip- 
tion. If they could think of no one who fitted the description, 
the item was to be left blank. 

The “Guess Who” test was scored by giving one point to a 
girl each time her name was inserted for a trait associated with 
adjustment, and a minus one for each time she was mentioned 
as having a trait which was associated with maladjustment 
The algebraic sum was then computed for each girl, and used 
as the score on the test. 

The Sociometric test was composed of six activities for which 
the girls were to name from among the other girls on their cor- 
ridor a first and second choice for companion in various 
activities They were also asked to name the girls whom they 
would reject as a companion in these same activities, with 
space given for a first and second choice 

The Sociometry was scored by giving weightings to first 
choices over second choices and the total score was the alge- 
braic sum of the positive and negative weighted votes. 

Analysis of Results 

The frequency distributions for each corridor on each of the 
tests were inspected. First, it was obvious that the subjects 
were homogeneous in the characteristics of sex, occupation, 
and age. Second, practically all of the frequency distributions 
took the form of a wide scattering, so the ranking of scores in 
order could be done with some assurance that unreliability of 
test scores would not greatly influence these rankings. The 
distribution of the Fa-S scores indicated a clustering at one 
extreme which increases the unreliability of this measure for 
comparison with other tests. 

Rank difference correlations were computed between each of 
the measures on each of the eight corridors. Thus, eight rho s 
were obtained for each test comparison. The median of these 
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correlations is taken liere as tlie measure of the degree of rela- 
tionship between the different measures of adjustment. 

I'ahiiity qf .\n analysis fd' the student’s rating 

of her “neurotic tendency" with the evperds rating of her ad- 
justment and with the peer's ratings of a<ljustment and accepta- 
bility produced only very low positive correlations. The 
median correlations between the Bi-X and other te.sts were; 
Bi-N- Expert, ib; Bi-N ‘‘(tuess \Vhft", .24; Bt-N-- -Socio- 
metry, ,14. 

In comparing the I‘2-.S scale (ff tiie Bernreutcr to the other 
measures of adjustment, similar results arc found. Practically 
no correlation was found between the expert's rating and the 
E'a-S, the median being .04. The meilian between the Fa-S 
and the “Gviess Who” was .05. an<l hetvseen the I>VS and 
Sociometry test was .01. Since the E’i-S rankings appear less 
reliable than the others because of a clustering of low scores, 
relationships between it and the other measures might be 
slightly higher wi th a wider scattering of scores. The low rela- 
tionship between this scale <ff self-rating and other measures 
strengthens the evidence of lack of self-insight as noted in the 
intercorrelation.s of Hr-N and other measures. 

Other pos.siblc eaii.ses of these low eorrelacion.s should be 
considered. First of all the low correlations may be due in 
part to the unreliability of the testing measures. However, 
the reliability of the Bi-N scale has been reported as .91 and 
.88, and for the Ka-S scale .78.* Studies previtmsly made which 
have used similar “Guess Who” and Sociometry tests have 
generally found reliability coefficients of .90 and above.'* The 
reliability coefficient of the Expert's Rating Scale established 
by test re-test method was .76. These coefficients indicate 
that the tests used in this study are quite reliable, so that the 
low relationships existing between them would not appear to 
result very much from unreliability of the measures. 

Another explanation of the low rclatic)n.ship.s found between 
these measures may he that in spite of attempts to make them 
comparable, the tests may be measuring different aspects of 

'Hid. 

*Tyron, Caroline McCann. “Kvaliiationa of Adolescent I’ernonality by Adoles- 
cents." Monographs oj ths A’eoe/y Research iit Child Deoelopmeiil , IV (1939), 1-83. 
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adjustment. At our present stage in the development of per- 
sonality testing the validity of each of these measures cannot 
be positively established However, they are used in general 
practice today as measures of adjustment as used in this study 
Lack of self-insight is another possible reason for the low cor- 
relations between the rating measures, and appears to be the 
mam reason for the results which were found 

Relationship Among Different Measures of Adjustment 

How many measures are necessary for an adequate measure- 
ment of adjustment? Do two different tests filled out from the 
same source, i e , two peer ratings, give very similar results? 
Do ratings by different sources agree? 

Correlations between the Sociometry test and the “Guess 
Who” test (both peer ratings) were high and positive. They 
ranged from .50 to .98 with a median correlation of .86. These 
results indicate that there was a higher relationship between 
peer ratings of acceptability and reputation of most of the 
corridors 

Two other measures of adjustment from the same source 
are the Bi-N and Fa-S scales of the Bernreuter, both measures 
of self-rating. Correlations between these measures ranged 
from a high of .58 to a low of —.04 The median correlation 
of .40 indicates a rather low relationship between the two meas- 
ures These two scales were chosen for this study because 
they were said to measure somewhat different aspects of ad- 
justment. Therefore, although they both use a self-rating 
approach, the tests differentiate fairly well between two dif- 
ferent personality characteristics. 

How well do the three different sources of judgement agree? 
The median of correlations between the Expert’s Rating Scale 
and the Sociometry test was .34. The median correlation 
between the Expert’s Rating Scale and the “Guess Who” test 
was 40. These measures show that, in general, measures of 
adjustment obtained from judges seeing people in a different 
light show some, but rather low, agreement. And it will be 
recalled that the median correlations between self-insight and 
the ratings of these outside judges were very low. It is con- 
cluded, then, that all three approaches to the measurement of 
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adjustment, i.e.. self-rating, peer-ratins<:, and expert-wring, are 
needed in any attempt to measure adjjistment a.icnjtiatciy. 

Comparisons of Exiranr Cases 

Although there is little relationship !>ct\vceii these approaches 
in judging the degree of adjustment over the cntiic djsfriliution, 
there is the possibility that extreme cases might he more con- 
sistently located. That is, a girl wlut was rated as outstanding 
in adjustment or who was well liked, .should, if anyone, fed 
well adjusted. In order to investigate this pns*iihility, the 
worst and best-adjusted girls on each measure in every ('orridor 
were located and their scores on the either tests studied. 

A great deal of disagreement was found hetween the median 
ranks of the best and worst girls on each criterion test as com- 
pared with their median ranks on other me.asures. This is 
shown by Tables i and 2, For example, the mediasi rank of the 
girls who rate themselves as worst on the Hi-X would he iK, but 
their median ranks were 6, 7, and 1 1 cm the expert’s rating.s, the 
“Guess Who,” and the Sociometry, respectively. .NIedian 
ranks of 6 and 7 indicate a slight tendency for the expert and the 
peers to rank these girls as better than average, and the rating 
of II on the Sociometry is not far from the miii-point of 9.5. 

Similarly, the median ranks of girls who considcriai them- 
selves as best adjusted on the Hi-N showed no agreement with 
the median ranks of these girls on other measures. 'I'heir 
median rank would be I on the Bi-N, hut was 7.5 on Fi-S, H.5 
on Sociometry, 9 on the “Guess Who”, and 9.5 on the exfiert’s 
rating. The same lack of similarity is found in comparing the 
ranks of the best and worst adjusted on each criterion test 
with their ranks on other measurc.s as is .seen in Tables 1 and 2. 

The evidence from these comparisons indicates: (tl that 
there is little agreement in extreme cast-s between .sclf-insight 
into adjustment and the ratings of others: U) there is licth 
agreement as to the most maladjusted (»r the hesi-adjustet 
girls on each corridor as rated by self, peer.s, or an expert 
Not only do these different approaches to adjustment show little 
relationship in the entire distribution, but {ilso they fail to 
agree in locating the extreme cases of good adjustment or mal- 
adjustment, 
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These results are somewhat startling when we consider that 
extremely abnormal cases are sometimes located from a group 
by the use of only one approach to the measurement of adjust- 
ment, Our evidence indicates that such an individual may be 
anywhere within the distribution if rated by a different ap- 
proach. While such a lack of agreement in locating extreme 
cases would not be expected from measures which all purport 
to^|mcasure the same tiling, the present evidence indicates 
the need (i) for helping iruliviiluals gain better self-insight and 

I ABLE 1 

Median Seurts on Oiher Teels oj Worst MjusteJ (rani oj rS) on Cnierson Test 
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5 
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6.8 i 

11 
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(i) for using more than one approach in judging the degree of 
adjustment either before or after counseling. 

The results of this study suggest that in counseling it is 
important to remember that self-insight may have very slight 
relationship to a person’s adjustment as determined by other 
measures. If other measures are considered, the final diagnosis 
made by the psychologist may be in direct disagreement with 
the complaints expressed by the client. On the basis of self- 
diagnosis it is pos.sible for the wrong persons to be selected for 
therapy. Also on the basis of self-diagnosis, those who are in 
need of treatment are often not identified. Thus it seems 
that self-insight cannot be relied upon as the sole method of 
selection for therapy. 
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iS'mniihiry unJ Condm'mu 

The results of this study sIkwccI; 

(1) There is a lack of sell'insiuhr inr<i nnr's r^vn luljusf- 
mentks determined by comparisons of sdf-ratinus to rariiius by 
peers and experts; median intcrcorrdatirms on dylit torndors, 
between measures were from .01 to .24. 

(2) Intercorrdations showed there is little aurednent In-- 
tween any two of the measures, except hei\vct:!i the "(»ucss 
Who" test and the Sociometry where the median of (orrdio 
tions on the corridors was Mi, 

(3) There seemed to be more consistency in ratimts from one 
source of judgment on two rating devices than k'tvu'cn dif* 
ferent sources of judgment. For example, the hiuh correlation 
of ,86 between the two measures of pecprating and the correla- 
tion of ,40 between the Bi-N and Fi-S. 

(4) These three approaches to rating ndjusunent not only 
disagree over the entire distribution of cases, hut also dis.mree 
in locating those girls who are extremely maladjusted or very 
well adjusted. 

Since the three different measures do mat agree in huaring 
cases of maladjustment, no one measure ■'.lioiild be taken as 
adequate evidence on which to base a diagiucsis, or on which to 
determine the outcome of therapy which 1ms been undertaken, 
It appears that three or more different .stiurce.s arc generally 
needed to give an adequate picture of one’s adiustment. 

364 P‘ 7 



A RI'VIFAV OF SOME PROBLEMS RELATED TO THE 
MAIL (^rESTIONXAIRE TECMNICJUE 

RALPH 1). XHRMAX 
i’rinieton Univcnity 

Ix all probability, more studies have been made with the 
questionnaire than with any other instrument in the field of 
social investijration. Wide application of this research tool oc- 
curs in sociology, education, psychology, economics, politics, 
public opinion measurement, and other areas of social science. 
ThivS article will attempt to survey some of the more recent 
literature concerning only the mail questionnaire, discussing 
problems peculiar to this instrument. Fundamental questions 
(reliability, validity, wording of questions, etc.) anent the tpies- 
tionnaire metluid in general are too numerous to cover here, 
since not only arc there many different types of questionnaires, 
but the field has been covered capably elsewhere. There are 
good clLscussions by Symonds (31) and Blankenship (3) and in 
the periodic reviews which have appeared from time to 
time (n), Basic considerations of methodology are also avail- 
able in Kelley (la) and Koos (13). Recently McNemar (16), 
Crespi (6), and Conrad (5) have debated the questionnaire tech- 
nique as applied to opinion-attitude research, and Ellis (8) has 
reviewed the validity of personality questionnaires. 

I. The problem of Returns in Mail .Questionnaires 

To be considered here is the problem of returns, independent 
of the characteristics of respondents vs. non-respondents which 
will be considered in section two of this paper, 

Percentage of Initial Retm‘n.-~T]\Q percentage of return is in- 
fluenced by a great many factors, among which may be men- 
tioned the use of follow-ups, inducements or appeals of various 
sorts, the time when the questionnaire is sent, etc. Reviewing 
only a sample of the various investigations which have reported 
returns on a single questionnaire or the first wave of several 
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waves of questionnaires we have jicrccntages of rcnirns reported 
by various workers as follows: 

Lazarsfeld (14), 15%; Ram ("-)<, *5 “ 5 %: •'^urhman and 
McCandless (30), 17%: Shutrleworth S26I. i<j%; Rollins 
(25), 23%: Lindsay (15), 27%; Stanton 129L 28%; Ball 
(i), 40%:Reid (23), 42%;Mudrfnv (ikf, f>o%;Toops (34), 
65%; Kelley (ill, 7 ^%-^ 

This represents a wide variation indeed, some tif the causes 
of which are suggested in the discussion which follows in the 
remainder of this paper. 

Follow-Ups . — ^The percentage of return is affected markedly 
by follow-up or other motivational devices. I Isirii!; follow-up 
letters only, Toops (33) achieved on one occasion almost a per- 
fect set of returns, or 93%, and on another occasion (34) a 
perfect set or 100% return. In the latter instance, by means of 
six follow-up letters, he secured the following cumulative per- 
centages of response after each follow-up letter: 65, Hj, H9, 97, 
99, 100. Reid (23) brought his percentage up from 42 to 69 by 
means of three successive waves of questionnaires. .Stanton 
(29) also used a follow-up in his study, as did Suchman and 
McCandless (30). The latter used three waves, the last of 
which was a telephone wave; the results were 17'.*? . 34' ’L ^md 
97 % (on the teleplione wave). In a second .stinly by the same 
writers, an original mail questionnaire followed by three waves 
of follow-ups brought returns as foilow.s: 44%, 46% . 
all together returning 95% of the total, Altliough .Sletfo (28) 
found that post cards were as effective as letters in making fol- 
low-ups, Lindsay (15) claims that a follow-up carvl and letter 
are more effective in their joint effect of iiulling returns than the 
initial letter and questionnaire. He suggests that later follow- 
ups come at greater and greater intervals of time. By thi.s pro- 
cedure in a later questionnaire, he received, witlt three follow- 
ups, 9^-5% oi" returns against an initial reply of 27(4 on a 
questionnaire requiring a half-day to fill out. Patterson (21) in 
his review of work on the questionn.aire, advocates a vigorous 
follow-up to increase returns, andToojxs (35) encourages an in- 
tensive follow-up technique which is designed to touch motives 
as viewed from the angle of the recipients. Concerning other 
motivational devices, Weaver (37) found that the inclusion of 
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a dupitfatc c«»py of the ipicstionnaire iiUTcasen the percentage 
of return. In armthcr instance the same investigator tripled 
his returns by claiming that no reply was desired! 

Other factjtrs, different from the characteristics peculiar to 
the respondent himself, which may influence the amount of 
returns may he enumerated as follows: 

Ketcard. Hanewk (tol used ftuir mcthoils of obtaining re- 
sponses to a questionnaire dealing with attitudes toward retail 
.stores. These were fa) a mailed questionnaire with no reward 
for filling it out ami returning; (h) a mailed questionnaire in- 
cluding 25 cents to he kept hy the recipient; fc) a mailed ques- 
tionnaire with the promise that 25 cents cvould he sent to the 
respondent if he returned the questionnaire filled out; and fd) 
a personal interview questionnaire. The percentages of return 
for each of the methods alaive were, respectively, 10%, 47%, 
18%, and 86%, He conclude.s that the second method is the 
best in terms of unit cost and accuracy of results. vShuttle- 
worth (a6) found that the enclosures of 25 cents in a simple 
questionnaire sent out hy mail brought 51.6% of replies while 
the .same questionnaire without the coin returned only 19.1% 
of replies. In the latter case, only a personal letter and 
a stamped envelope were useil. Rollins (25), however, found 
that when he used an attached pencil with the suggestion that 
the recipient keep it, he received 23% return on the first wave 
and only 13% on the second. In this case perhaps the effect 
of enclosing the pencil on both occasions negated the effect of 
the “bribe.” Care must be exerted, however, in using rewards 
which may be construed rather as bribes. One is not sure how 
much offense would be taken at this technique by an intelligent 
group of re.spondents. 

Form of the Questionnaire . — Moore (17) received an average 
return of 61% with typewritten questionnaires and 51% with 
duplicated ones. Toops (36) contends that proper lay-out, 
capitalization, and paragraphing improves the readability of 
the questionnaire. Blankenship (3), too, contends that general 
appearance will be one ofthc “determining factors” in inducing 
returns. Neither offers any research to substantiate these 
claims, Symonds (31) asserts that the design of the question- 
naire is most important and urges the use of a single sheet rather 
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than two if there is enough room. Attention must he paid, he 
says, to future statistical treatment by machine nictluKls, es- 
pecially if the sample is large and there are many questions 
used, 

Knovi'kdge Coticerning the h'ntdcr I'tMips 1^41 states that 
recipients who are best known to the sentler reply earlier than 
strangers. Kelley (la) maintains that there is a greater likeli- 
hood of not getting a useful answer it the recipient is not well 
known to the sender. In thi.s connection, Boring's 14) in- 
junction concerning questionnaire-answering urges this as one 
of the points to be ob.servcd in considering whether or not to 
reply. The National Education Association <19), .surs'cying 
percentages of reply received by various classes of tpte.stion- 
naire circulators, reports the following interesting table: 


Orisinotor of QiKsHonmiire 
City supt, or member of central office 

State office 

School principal or other schrsil employee 

Publishing firm 

College professons or students 
Private association or foundation 
Miscellancou.s . 


Mtdim ' rtj Kfpty 

7?. 4 

"T! .0 

hi .0 
ho. 4 
.0 
7N , t 


Thus, there would seem to be some relationship hctw’cen the 
originator and the percentage of reply on a rough prc.stigc hier- 
archy. 

Time of Issuance of the ^Questionnaire. }\arly in the w'cek 
and early in the school year seem to be the best times for re- 
ceiving replies. Toops (33) reports that the highest returns in 
his investigation were received on Monday and Tuesday and 
only about half as many on each of the other four day.s of the 
week. The National Education Association (lyj. in the study 
cited above, presents a table wliich indicates that an average 
0^75% return is to be expected if the questionnaire is issued in 
September, October, November, or December, but only %% 
average return will accrue in January, February, March, April 
or May. This, of course, applies to school questionnaires. 
The above results appear to suggest strongly that in dealing 
with potential respondents it is better for the investigator to 
make some preliminary inquiry concerning whether or not his 
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respondents wouki be expected to receive the questionnaire at 
a time which is convenient for reply. 

Length of the t^uestinnnairc. That tlte length of the ques- 
tionnaire may have something to do with the percentage of 
return may be presumed on an a priori basis. Recipients do not 
wish to be annoyed vitli a long questionnaire. Toops (35), 
c.g., cautions that undue length is a .symptom of "slovenly 
technique." There is some experimental evidence for this con- 
tention as noted in the following table jircscnted by the Na- 
tional Education Association (19) in their summary of ques- 
tionnaire-answering behavior; 

Sinnher <'/ //oiM “j litfor- 
iMiitu'ii Rrqufitfii 
5 or less 
h 10 
n 15 
i<> 10 
:i 30 
31 40 
41 

51-75 

7S--100 

101-500 
501 1000 
iSoo I <>00 

Thus, except for a reversal in the middle of the table, it would 
appear that there is a rough relationship between the length of 
the questionnaire and the amount of reply. 

a. Respondents vs. Non-Respondents to Mail ^Questionnaires 

Most cautious investigators who have examined question- 
naires, especially the mail type, have realized that the matter 
of who returns a questionnaire is a vital one to any investigation 
which undertakes to use the postal inquiry as its basic instru- 
ment. The problem is: Are those individuals who reply to a 
tiuestionnaire representative of the population to whom the 
questionnaire was sent? A corollary of this question is one 
other: Is there any difference between early and late respond- 
ents? Also related to this problem is that of the means to 
secure increased, or more representative returns, discussed on 
the preceding pages. 
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Thorndike in his critique f»f the questionnaire method says; 

Psycholoeieal que.stifiniiaires are lonnnoniy answered hy 
only a limited nunilxir of those who reeenv thens iiainrly, by 
the individuals to whom the questions cstvcially appeal and 
who have someting to report . . . The icpbes thus represent an 
extremely partial .sampling fd' iwople m ueiu-ral. (J2, p. jjj 

Symonds, too, raises this question, ctimmentinp iqwn it in 
greater detail: 

It should be remcmlKired that in most impiirie . tlie rhotcc of 
those to W'hom .schedules aie .sent is a delicate issue, When a 
considerable number fail to lie returned, the repic-entafivcncss 
of the sampling may be seriously deranged. The investigator 
must always ask himself if there is a probahility that those who 
failed to answer did. If those who do nor answer fad to do so 
because of lack of interest or iKi’anse itf ignmaitce. there is a 
strong probability that their retuins, if they cniild be obtained, 
would alter the results. Usually when returns are received 
from only a .small iwrcentage of those to whom question Maiiks 
are .sent, some e.stimate must Ik; made which allows for tin-, 
factor of selection. (JJ, p. 119) 

Research is almost unanimous in corrohoratintt tlicsc com- 
ments by Symonds concerning the tlifFerences hctwecii thitu* 
who do and those wlio do not reply to cjuestionnaircs. The 
only dissent comes from Toops (34) who slates that the es- 
sential conclusion of his study wms not materially changed 
through the replies obtained by follow-up lettcr.s, although he 
does say that with respect to other conclu.sions this would not 
necessarily hold. In an earlier study, Toops (33) found that 
neither the early nor the late returns were a biased saitipling of 
all returns, so far as the most essential question of the study was 
concerned. On the other hand, there are several studies which 
do not bear out Toops’ contention. Ball fi), using: follow-up 
letters or questionnaires containing .six simple tpicstion.s which 
were sent to the parents or guardians of delinquent hoys re- 
leased from a boys’ school in San b'rancisco in lyjh. 1927, and 
1928, reports that parents arc more likely to answer tlie quc.S“ 
tionnairc if their report is favorable. Kelley (la), in .semiing 
a questionnaire to faculty members of a univer.sity, noted that 
he was not likely to get a useful answer if the recipient held a 
minor position of one-year tenure. More elaborate studies by 
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Other invcstiuarors arc striking in their unanimity concerning 
the tliffercnces between respondents and non-respondents. 

Stanton (29) for example, using a three-page mail question- 
naire which was sent to a representative list of 11,169 flnited 
.States school teachcr.s, inquiring among other thingvS about their 
possc.ssion and use of classrwm radio receiving facilities, found 
that the replies of the teachers whtj needed a follow-up differed 
markedly from those who made an original reply. There were 
significantly Ic.ss who ownctl a radio in the classroom in the 
former group. Reid (23) in another questionnaire on tlie use 
of radios in scliools, this time in Ohio, followed up a sample of 
nan-respondents. There was a consistent decrease in the per- 
centage of affirmative responses with each succeeding group of 
respondents in three successive waves. He felt that probably 
the primary reason for this was lack of interest; those principals 
interested in radio tended to answer and to return question- 
naires on radio more readily. Similar results on an occupa- 
tional survey were found by Shuttleworth (27). He sent ques- 
tionnaires to 327 technology and chemistry majors graduated 
from the City College of New York in 1936. Repeated efforts 
to contact these alumni brought information concerning all but 
four of the 309 for whom there were sufficient addresses. The 
first 184 returns showed only ,5% unemployed, while the next 
lai returns showed 5.8% unemployed. In the case of the 
technology majors, 65 early returns showed only 15.4% em- 
ployed outside their field of training; 54 later returns, however, 
showed o.g. 6 % thus employed. A similar trend also held for 
chemistry majors. Former college students were also followed 
up in another study by Pace (ao). He found that non-returners 
(of questionnaires) for both sexes were heavily weighted with 
students leaving at any time prior to the completion of nine 
quarters of work, Graduation from the university was also re- 
lated to return versus non-return. He investigated further the 
late returners versus the early returners and found that late ver- 
sus early return was somewhat prognostic of return versus 
non-return. He states that whether or not a person will return 
a questionnaire and when he will return it depend on a favorable 
combination of all of the factors which influence questionnaire 
returns: interest, conscientiousness, promptness, time available, 



14 - EDUCATION'AI. .AND I’SVCHtJl.fKHC.A 1 , AJT ASTRI HiFN'T 

pleasurable associatifins with the sfjuuc uf the questionnaire, 
sufficient lack of emharmsKment wiili one’s present statu.s to he 
willing to report that status, and many (»fhcr factors. Reuss 
(24) also reports similar results. A frtl!rm--«p study of 1,097 
college students was made by means rU’a fnasled questionnaire. 
Marked differences c.xisted between resjwjndents and non- 
respondents; higher intelligence, sectres and .schrilarsbip, loyalty 
or ties to the questionnaire spon.s'or, and a rural backgrovind 
were associated with a po.sitive tendency rn resjamd. 

Suchman and McCandless (jo) find substantially the same 
pattern in another type of research, that concerned with radio- 
listening behavior. In two separate iiive.sriuatinns reported in 
the same article, they studied (a) a ramiom list of fw women 
to find out whether they listened or duiii’t listen to a child- 
study broadcast program, and (h) a runilom li.st t»f cyxj listeners 
who subscribed to a classical music program bulletin. In both 
cases differences between the two groups who replied or did not 
reply to a mailed questionnaire concerning the prouranis were 
ascribed by the authors to interest or familiarity with the topic 
under investigation and to the education fif the respondent. 
Rollins (25), seeking to find out for his magazine how many 
readers had ever flown on a commercial airline, fouinl that 17% 
among the first wave of respondents had flown, but only 7% 
among the second. He concluded that it was obvious tliat 
those who were more interested in flying were likely to ansAver 
the first time. Toops (35) gave early .support for this matter 
of interest, for, in his examination of 135 qviesticmn'iurcs stwlies, 
he offers advice to select for study a topic in which the recipi- 
ents are “vitally interested” in order to assure a high percent- 
age of returns. 

Franzen and I^azarsfeld (9), writing on the mail question- 
naire as a research problem, undertook to find out what caused 
people to balk at answering mailed que.stionnaires*. They sent 
out questionnaires to 3,000 repre.seiitative subscribers to Time 
magazine, 1,000 each of three slightly difterefit forms; 505 per- 
sons who replied and 882 who didn't reply were personally 
interviewed. Their results indicate that mail questionnaires 
can produce valid samples of comparativ'ely homogeneous 
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groups and that the answers to some questions given in a mail 
questionnaire are more informative and more freely given than 
the answers the same people give to the same questions when 
face to face with an interviewer. Tliere is a freer admission, 
e.g., by mail, of unusual activities or interests, of buying power, 
of pensonal income, than is nuule to the personal interviewer. 
This study is unique in showing, in this fa.shion, that greater 
validity may sometimes be achieved by the mail question- 
naire- • it is of great value to consumer rc.searchers, for example, 
to know that the impersonal mall questionnaire will be more 
fruitful on these items. On the negative side, these authors 
indicate that statistically significant biases do occur in mail 
returns, and the possibility that they may be large enough to 
prejudice generalization must be provided for in any survey. 

In a somewhat difierent fashion, a German investigator, 
Mudrnw (i8), also proceeded to determine whether there were 
characteristic differences between the group who answered ques- 
tionnaires and those who did not. Proceeding by means of 
personal contact, letters, etc., he studied the results available 
from 4,000 answered questionnaires, the number returned out 
of 10,000. The following reasons, the author claims, are the 
more important for not answering; indifterence, negligence, sus- 
picion, lack of understanding, fear of affecting their status 
(given by women), and minimizing the importance of personal 
data. Opposed to these characteristics are those of the group 
who gave replies. Considering the problem from the consti- 
tutional-biological point of view, the author suggests the possi- 
bility that the non-answering group might have a larger per- 
centage of cyclothymic personalities. 

Excellent illustrations of bias in questionnaire surveys in the 
field of public opinion have been presented by Benson (a). He 
points out (a) that under certain conditions people in the higher 
income and educational brackets will return mail ballots with 
consistently greater frequency, (b) that a disproportionately 
greater percentage of people who were strongly opposed to the 
1937 Supreme Court "packing” proposal by President Roose- 
velt made a special point of registering their protest in a mail 
survey, and (c) that the mail ballots used by the Literary Digest 
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in polling the 1936 Presidential elcetirm erred by the amazinelv 
high amount of about 20% tsccause of strung prejudice on the 
part of the respondents, 

A recent article by Edgerton, Britt, ami Xorman tyj presents 
striking objective evidence of bias in mail returns. 7 ’hcy con- 
ducted a follow-up study of all male contestants in the First 
Annual Science Talent Search by means of a mailed question- 
naire. There were three classe.s of contestant wliirh emerged 
as a result of the search, which was a nation-wide contest to 
discover scientific talent. These three tdasse.s were winners, 
honorable mentions, and others, or "also ran.s." 'Phese investi- 
gators found that winner contestants make almost |K*rfect re- 
turns of the questionnaires for each of three follow-up vears, 
honorable mention contestants make the next largest percent- 
age of returns, and the “also rans" have the lowest percentage 
of returns. A second part of their study concerning the oV/ewe 
Aptitude Examinution scores of the "also-ran.s" for fotir follow- 
up years reveals that if individuals continue to reply faithfully 
to the questionnaire year after year for four years they tend to 
be superior on this test to those who make no reply who reply 
in any lesser degree of succession. Moreover, there is a rising 
mean value on the aptitude test in direct relationship to the 
frequency of replies, disregarding succession, t ’.sing the fourth 
year of follow-up only they found that early respondents had 
a higher, although statistically not significant, mean score than 
late respondents. 

The implications of these findings concerning the problem of 
who answers questionnaires are obvious. Since tics to the ques- 
tionnaire sponsor or interest in the subject under inve.stigation 
are productive of higher returns, intensive and vigorous follow- 
up is a basic tenet of all mail questionnaire research. Other- 
wise, the tendency will be to obtain replies from those who have 
a special interest in the subject under study, or who exhibit 
some characteristics different from the non-resptmdcnts or from 
the casual or indifferent respondents. 

Summary 

In reviewing the literature concerning some of the problems 
peculiar to the mail questionnaire technique, it may lie con- 
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eluded that the percentage of return on a single questionnaire 
may vary widely. This percentage is decidedly affected by 
various devices and by the characteristics of the respondents. 
Follow-ups in general increase the percentage of return, as do 
simple rewards. There is little research evidence on the form 
of the questionnaire as related to returns but, as regards knowl- 
edge concerning the sender, there is some evidence for relation- 
ship between the originator and percentage of reply on a rough 
prestige hierarchy Time of issuance of tlie questionnaire, es- 
pecially in education, is of import. Undue length is to be 
avoided since the amount of reply may be decreased by a large 
number of questions. Tliose who respond to a mail question- 
naire have been found, almost universally, to differ radically 
from those who do not reply. It is probable that late respond- 
ents also differ from early respondents. 
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PERSONALITY FACTORS IN THE PSYCHOLOGICAL 
WEANING OF COLLEGE WOMEN* 


ARTHUR W. SHERMAN, JR. 

Ohio University 

This study is a continuation of an earlier study (2) the pur- 
pose of which was (a) to develop an inventory that would be 
suitable for measuring the emancipation status of older ado- 
lescents, and (b) to study certain factors which seem to be re- 
lated to the emancipation status. In the former study the 
results obtained by use of the inventory showed that college 
women were less emancipated than college men. 

The purpose of the present study is (a) to determine the 
relationship between the degree of emancipation of college 
women and certain personality traits as measured by the 
Bernreuter Personaliiy Inventory, and (b) to determine the 
relationship between the emancipation status of college women 
and certain personality traits of their parents. 

The Emancipation Questionnaire (copyrighted as the Par- 
ental Relationships Inventory), devised for and used In the 
original study was revised so that in its present form it includes 
the 35 items** that were found to be most diagnostic by appli- 
cation of the criterion of internal consistency. An item 
analysis of the revision confirms the findings from the first 
study with regard to the diagnostic power of these items. No 
item was used in the present scale that failed to reveal differ- 
ences between the most and least emancipated persons. The 
seven items that have the greatest diagnostic power are: 

'This swdy was nmde possible through a grant from the George Dnvis Bivin 
Foundation, Inc. 

The wri ter wishes to express his npprecintion to Dr. Irmn li. Voigt, Dean of Women 
of Ohio Universi ty, for her cooperation in the securing of the data, and to Dr. James R. 
Patrick, Professor of Psychology, Ohio University, for certain suggestions in the in- 
terpretation of the data. 

This paper was read at the annual meeting of the Midwestern Psychological As- 
sociation in Chicago on May 3, 1947, 

' See (a), pp. i74-’i77, i8o. The items included in the revised questionnaire are; 
h 3 , 4> 7> 8. 10. la, 13, J4, 16, 17, no, 21, 28, 29, 30, 34, 33, 3 i. 36) 37 , 39 , 4 °, 44 , 49i 
5I) SI, S 3 , S 4 , SS, S 6 . S 7 , S 8 , S 9 , 60. 
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When I am feeling blue I usually hmk tn my parents fnr 
comfort. 

I often wish that my parents 'U"ie living nearer to the uni- 
versity so that I could see them more frequently. 

After being with my parents f<u a vacation fH’nmi. I hml it 
very difficult to leave them. 

I often wish that my parents were here at the university sn 
that I might discuss my problems with them. 

When writing to my parents, I tell them everything I have 
done in the past few days. 

I often wish that my parents would visit me at the university 
more hequently. 

I decide what courses I shall pursue without assistance from 
my parents. 

Procedure 

The revision was administered to 504 college women meeting 
the following criteria: (a) unmarrictl (b) not living at home 
(c) grew to maturity in a liomc which incliulcti tlie presence 
of both parents (d) both parents living fc) not a veteran of 
World War II. The 504 women ranged in ages from 37 years 
o months to 15 years 7 months, the mean age being 19 years 
6 months and the median age 19 years 4 montli.s. The women 
represented the four undergraduate classes at Ohio University 
as follows: 22i freshmen, 135 sophomores, 92 juniors, and 56 
seniors. 

The Emancipation scores ranged from 8 (le:ust emancipated) 
to 33 (most emancipated) out of a possible total score of 35.* 
The mean Emancipation score for the group was ai.oH with an 
S.D. of 5.29. 

Since the Parental Relationships Inventory was administered 
in class rooms and to groups in residence lialls, sororities, and 
cottages, there was some duplication. Sixty-two (62) women 
were retested, but in no case less than two weeks after the 
first administration. The test-rctest reliability coefficient was 
found to be . 82^,04. 

On the basis of the total scores on the Parental Helatianships 
Inventory, the upper 20% (most emanci]iated) aiul the lower 
ao% (least ernancipated) were determined. The individuals 
in these two groups (106 in the most emancipated group and 

’ Each emancipated response is given a score of i. Uiiemancipnied and oucstion* 
mark responses are given a score of o. 
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102 in the least emancipated group) were requested to report 
at scheduled times for the purpose of accomplishing the Bern- 
reuter BersonaWty Inventory. Ninety per cent (90%) of the 
women scoring in the upper 20% and 90% of the women 
scoring in the lower 20% completed the Bernreuter. 

At the close of the testing period, these individuals were 
requested to address an envelope to their parents. In this 
envelope was enclosed a letter prepared by the writer asking 
the mother and father to accomplish independently and 
anonymously the Bernreuter Inventory and the Strecker 
questionnaire.' The forms were clearly marked “Mother” 
and “Father” and were coded so that they could be paired and 
separated into the most and least emancipated groups Replies 
were received from 82% of the mothers and 75% of the fathers 
of the most emancqiated women who had completed the 
Bernreuter; 67% of the mothers and 64% of the fathers of the 
women in the least emancipated group tliat had completed tlie 
Bernreuter replied. 

-The Findings 

The results obtained on the wovien in the least and most 
emancipated groups are shown in Table i. 

1. It will be recalled that a low score on the Bi-N scale is 
desirable.® I'his indicates a tendency to be very well balanced 
emotionally. The difference between the mean raw scores for 
the most emancipated and least emancipated groups is 31.6, 
with the most emancipated group having the more favorable 
score. This difference is significant at the .01 level.® 

2. On the B2-S scale persons scoring high prefer to be alone, 
rarely ask for sympathy or encouragement, and tend to ignore 

*ln private communications between the writer and Dr. Edward A. Strecker, 
author of Thttr Molheis' Sons, and the publishers, J. B, Lippincott Co., permission was 
granted for the reproduction of the questionnaire published in Chapter 19 of the above 
cited book. This quc.stionnaire is csscniially a chc'’!' the 

extent to which they as.si.st the child in obtaining . ■ The 

findings from the admini.stration of this questlonnn . . urther 

analyses arc made. It appears from the manner in which the questionnaire was used 
in this .study, that both the mother and the father in most cases collaborated in answer- 
ing the items and that they were motivated to reveal themselves In the most favorable 
lignt rather than to evaluate their own feelings and actions honestly and objectively. 

'The.se interpretations arc taken from Robert G. Bernreuter, Matiml for the 
Personotity Xmenlory, Stanford University Press, Stanford University, California, 193J. 

* Significance at the .01 level is Implied in subsequent references to the significance 
of differences between mean scores 
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the advice of others. The difference between the mean scores 
for the extreme groups is 50, with the most emancipated group 
being more self-sufficient. This difference i.s significant, 

3. On the B3-I scale a low score indicates the tendency 
toward extroversion. The difference betw’ecn the mean scores 
for the extreme groups is 11.2, with the most emancipated 
group being more extroverted than the least emancipated 
group. This difference does not meet the criterion for signifi- 
cance. 


TABLE I 

Compatison tj Mean Raw Seorej on Six Seales rj lie Herrireiiler Perjemahtj' Inceniory 
Between College Women j» the Most end I^an Bmanupaud (ireiups 
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4. On the B4-D scale a high score indicates the tendency to 
dominate others in face-to-face situations. The difference 
between the mean raw scores for both groups i.s 4I.4, with the 
most emancipated group being more dominate than the least 
emancipated group. This difference is significant. 

5. On the Fi-C scale a low score indicates the tendency to 
be wholesomely self-confident and well adjusted. 'I'hc differ- 
ence between the mean raw scores for both groups is 51, with 
the most emancipated group being more self-confident than 
the least emancipated group, This difference is significant. 
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6. On the Fa-S scale a low score indicates the tendency to 
be sociable and gregarious. The difference between the mean 
raw scores for the most emancipated and least emancipated 
groups is 54-5) with the least emancipated group being decidedly 
more sociable and gregarious than the most emancipated 
group. This difference is statistically significant. 

It will be noted in Table i that the mean raw scores for the 
most emancipated and least emancipated groups on the Bi-N 
and B3-I scales are below the mean raw scores of Bernreuter’s 
norms, whereas on the Ba-S and Fa-S scales the most emanci- 
pated group lies on one side of the Bernreuter norm group and 

TABLE 4 
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the least emancipated group on the other side, as might be 
expected to occur. For the B4-D and Fi-C scales we find that 
the mean scores for the least emancipated group lie very close 
to the mean scores for the Bernreuter norm group. 

The results from the Bernreuter Inventory on \\\& parents of 
the women in the most emancipated and least emancipated 
groups are shown in Tables 1 and 3. The inventories received 
from the parents were carefully checked to determine the extent 
to which parents might have collaborated in completing the 
inventory. It was found in checking the ten cases where the 
raw scores for the mother and father were within ten points 
of each other that this proximity was not the result of an item- 
by-item agreement on the Bernreuter, 
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In Table 2 is shfiwn the cmiipari5>nn of the nuMti raw scfircs 
on the Bi-N, Ba-S, and B4-I) scales tit the Bernreuter between 
the mothers of the w'omen in the most and least enrancipated 
groups. The differences found arc very slight anti statistically 
insignificant. 

In Table 3 is show n the comparison of mean raw scores on 
the Bi-N, Bz-S, and B4-D scales of the Hernreuter between 


TAIH.K .1 

Compaiisoti of Mean /tatc .Vfor« im Thrte Se.iki ' f thf Rtmumcr P{rs<:"„ihly Iftimtwy 
Selwitn lAi Fatlitrs e/ i/it College H'nmen m lAe t ft //»;•!./ I/fiiel hfinheii'^teddruiips 



Bernrcultr >, 

KaihcfR ‘ 
of 

Fafhrfi 



Il=fi 

0 0,11 


Scjile 

Nomn i 
(Ailull < 
Mttti 

Ocl. DM 

) 

J'.manei- 

iit^l 

Vk omrn . 

.V n ' 

1 

taatni 

.V 

oia ‘ 

jr llifi 

( ^anre-s 
m 

Bj-N 

! 







Mean ... 


-68 6 ■ 

'Vi r» 

4.ri 

K.88 



S.D 

79-0 i 

1 

J00.6 ' 

Hi u l 





Bl-S 



1 




Mean 

J2.3 1 

4l-f> i 

iV V 

1.1 7 

K 

1 


S.D 


^5'S 1 

^8.'/ 





Ba-D 

Mean 

io.o ! 

53.9 i 

'i 

W(.o j 

iM.l 

l.v 

I' .,i'" 


<7 

S.D. . , , 

S8.0 

67. 3 1 

S»'7 , 






the fathers of the women in the extreme group.s. The differ- 
ences here are likewise very slight and/or statistically in- 
significant. 

Other Factors Related to Emancipation tstatus 

The most emancipated group was found to he somewhat 
more intelligent, on the average, than the least emancipated 
group. A significant difference of 10.9K was found between 
the two groups on the basis of raw scores on the Ohio Rtale 
Psychological Examination (Forms 11 and 22) 'This ctir- 
roborates the findings from the original study (2. p. 179). 

The most emancipated group was found to be K.g months 
older, on the average, than the least emancipated group. This 
corroborates the findings from the original study (2. p. 179). 

In this study the ages and schooling of the mothers and 
fathers were studied for one-half of tlic group. These factors 
seem not to be related to emancipation. 
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Sut}ima7'\ 

In summary, wc find these statistically significant differ- 
ences between the most emancipated and the least emanci- 
pated groups; 

I. Tlie most emancipated women were found to be more 
stable emotionally, on the average, than the least emancipated 
women. 

1. The most emancipated women were found to be consider- 
ably more self-sufficient, on the average, than the least emanci- 
pated women. 

3 The most emancipated women were found to be more 
dominate, on the average, than the least emancipated women. 

4. The least emancipated women were found to be consider- 
ably more sociable and gregarious, on the average, than the 
most emancipated women. This finding suggests tlie po-ssibil- 
ity that friends and associates may in some respects play a 
role similar to that of the parents, and the feeling of helpless- 
ness may be the motivating mechanism that “moves her toward 
people.”’ If this discovery proves to be true then one needs 
to examine more carefully the motives of vuhy people seek one 
another. Sociability alone may not be a sign of maturity. 

5. The most emancipated group is, on the average, 8.9 
months older than the least emancipated group. This cor- 
roborates the findings from the original study. 

6. The most emancipated group is, on the average, somewhat 
superior in intelligence to the least emancipated group. This 
likewise corroborates the findings from the original study, 

7. There is no appreciable or significant difference between 
the two groups on the B3-I (introversion-extroversion) scale. 

8. The differences found between the mothers of the most 
emancipated women and the mothers of the least emancipated 
women on the Bi-N, Ba-S, and B4-D scales of the Bernreuter 
are very slight and statistically insignificant. 

9. The differences found between the fathers of the most 
emancipated and least emancipated women are very slight, 

’Homey (i) catBgorizc>) the development of conflicts in children into "moving 
toward people, against them, or awaji Jiom them" (p. 43). "When moving toward 
people he accepts his own helplessness, and in spite of hi-S estrangement end fears 
tries to win the affection of others and to lean on them." 
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except for the B2-S scale, with a difference of 13.7. None of 
these differences, however, are significant. 

10. The ages and schooling of the parents were found, on the 
average, to bear no relation to the emancipation status of the 
college women studied. 

All of the above statements hold insofar as we can accept 
Bernreuter’s interpretations of hi.s scales and if our scale 
proves to be a valid measure of emancipation. 

This problem requires further study of the relationship of 
the adolescent to the parents and the metlmd.s of cmitrol cm* 
ployed by the parents.* Detailed analy.sis of the interacting 
personalities of parents and child is es.sential to an ifnder- 
standing of the process of psychological weaning and the 
achievement of emancipation by the older adolc.scent. 
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• The writer is investigating this i>robleni further. 



NOTE CONCERNING “THE VALIDITY OF STANDARD 
AND CUSTOM-BUILT PERSONALITY INVENTORIES 
IN A PILOT SELECTION PROGRAM/” BY DONALD 
E. SUPER. 


DONCASTER (J. HUMM 
Angeles, California 

Donald E, Super’s study of the applicability of personality 
inventories reports such a lack of effectiveness on the part of 
several standardized personality tests that his article needs 
critical consideration. 

Since personality inventories have an important potential 
contribution to make to our understanding of human behavior 
and to our ability to predict the adjustment of individuals to 
various situations, they deserve extensive examination made 
carefully and with due regard for their complexities. 

Dr. Super states that three standard personality inventories, 
the Shipley Personal Inventory, the Adams-Lepley Personal 
Audit, and the HummAFadsworlh temperament Scale, have 
“no significant relationship with success in flying training.” 
He mentions the Guilford Inventories, the Maller-Glaser 
Interest-Values Inventory, and the Minnesota MulHphasic 
Personality Inventory in passing, but reports that they were 
not used. 

So far as the Uumm-tV adsworth temperament Scale is con- 
cerned, the study so briefly reported by Dr. Super does not 
justify any conclusion whatever as to its validity or as to any 
contribution it might have made to the selection of candidates 
for pilot training. An understanding of the circumstances 
may be helpful. 

At the request of an officer of the Air Corps who had been 
authorized in his civilian position to use the Ilumm-PVads- 
worth temperament Scale (not Dr, Super), I supplied Humm- 

1 This article by Donald E. Super appeared In Educational and Psycholooical 
Measurement, vII (1947), 735^44- 
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Wadsworth Temperament Scales and scoring and interpreting 
materials for administering the ricale to 500 caiiets ui pilot 
training. I did so with the understanding that I was to parti- 
cipate in the study, although the nature and extent <»} my 
participation were not formally defined. Thereafter. I was 
unable to secure any respon.se to intpiiries a,s to ho\i, the Scale 
was being administered and interjWetcd or what statistical 
procedures were to be useti in studying tlic rcsulr.s of its use or 
what criteria were to he used in evaiuatinu it. cxceju the state- 
ment that all this was a military secret. 

Inasmuch as I knew that the persons comluctinit the ex- 
periment did not have the specialized knowlcilgc nctxied to 
handle the Temperament Scale. I appealed to the Atljurant- 
General’s office, .An order was issued tljat the use of the 
Humm-Wadsworth Temperament Scale shmikl he lii.scontimicd. 
However, another ranking officer intervened, and 1 was re- 
quested to permit the experiment to contimic and to giv'c a,S” 
sistance to it. I was happy to do this, At that time, I was 
assured that the result.s of the experiment wandd he made 
available to me and that I was to have an op[>nrtunity to know 
what procedures were to be used. I received no further in- 
formation 

Instead, I received a listing of the score.s of jHla aviation 
cadets, Identified by number only, from which we prepared a 
description of the temperament of each .subject. Tlie.se were 
returned to the unit with the warning that the data were in- 
sufficient for prediction of success in flying, except in some 
exceptional instances. Their receipt was not acknmvkHigetl, 
and no report of the outcome of training of the subjects was 
given to me, 

Of the 38a subjects whose scores were .submitted to me, 201 
showed measures of response-bias within the probably accept- 
able range Since Dr. Super .states that the .study he reports 
was based on 202 cases, I infer that this .study was limited to 
the cases whose responsc-bia.s was within the range of probable 
acceptability. 

It is evident from Dr. Super’s report that the interpretations 
of temperament I made were not used and the warnings not 
observed. Instead, correlations were ccmiputed between the 



PERSONALITY AND PILOT .SELECTION 259 

scores of the separate components and a criterion — gradua- 
tion-elimination in primary pilot training. 

This is an erroneous procedure because the scores in seven 
components of the Humm-Wads'worth ^temperament Scale are 
meaningful only when considered in combination 

'Die most simple combination which can be used at all in 
predicting behavior is the relationship between the “Normal” 
score and the score in each of the other components, Blven 
this represents a serious oversimplification, since the other 
components also tend to reinforce each other or to inhibit 
each other or to give rise to unresolved conflict (a frequent 
occurrence which explains many cases of maladjustment and 
apparently inconsistent behavior). For example, the chief 
difference between the average temperament of successful 
workers and the average temperament of patients with manic- 
depressive psychoses is in the amount of integration present as 
indicated by the relationship between the Normal and the 
Cycloid components. Successful workers are usually accept- 
ably integrated; manic-depressive patients are, for the duration 
of their illness, disintegrated. Thus there is a vast difference 
between strong Manic accompanied by strong Normal and 
strong Manic accompanied by weak or borderline Normal. 
Again, strong Manic with strong Autistic presents a very differ- 
ent picture from strong Manic with weak Autistic or strong 
Manic with strong Paranoid. Again, strong Normal may be 
overwhemed by an exceptionally strong other component. 

Failure to consider these relationships among the components 
predisposes Dr. Super’s findings to the influence of counter- 
acting tendencies within the data which would mask the 
truth. 

A second problem which arises is that of response-bias, It 
is not apparent from Dr. Super’s report whether raw scores or 
profile points were used in the compilation of the data. If 
raw scores were used, response-bias was not accounted for 
except by eliminating those cases likely to be most seriously 
affected by this factor. This, however, would have the effect 
of curtailing the range and thus of artificially lowering the 
correlations. If profile points were used, then response-bias 
was compensated so far as it affected the cases that were in- 
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eluded, but unduly low correlations because of the effect of 
curtailed range would still result. Dr. Super mukl have 
compensated for curtailment of range hy the use f»f the follow- 
ing formula: 


(In which r “ the obtained correlation, r* the correlation 
obtained from data which mcUuk* the full range. <r,.3 is^the 
standard deviation of the cwtiniatc a-s ohtiuncd, and rr i i<; 
the standard deviation of the estimate rd the full array.) 

A third question w’hich arises is that ol any attempt to use 
the correlation coefficient with such data. 'Iwo points need 
to be mentioned. The first, our own acquaintance with these 
data indicates that the arrays arc markedly .skewed. Cor- 
relation ratio or correlation index woiilil have been preferable 
to product-moment correlation. The second point is that, In 
such a problem as this, which represents test validation on 
remote criteria (i), some form of multijile or partial correlation 
measures is necessary in order to estimate the influence of 
other factors present. To accept such a standard a.s low posi- 
tive correlation between one of the members of a test battery 
and success on the job is to leave many factors unaccounted 
for. 

A fourth question arises from the criteria used. Ordinarily, 
teachers’ judgments and supervisors' ratings seldom exceed a 
validity in which r = +.50. Dr. Super makes no mention of 
the validity of the ratings used. His findings should have 
been corrected with this formula: 

nrom rta = ~ i~ 

V roa 

(Validity of a score corrected for the validity of the criterion,) 

That the Humm-Wadmorth ^cale can be used 

to measure temperament validly and is useful in situations 
where prediction of behavior is needed lias been demonstrated 
by a number of studies. One of our own (a) showed agreement 
between Scale scores and carefully conducted and verified case 
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Studies in 91 per cent of the comparisons (roughly equivalent 
by the method of unlike signs to a correlation of + 96). 

In another instance, 506 war emergency policemen were 
given an intelligence test and the Humm-Wadsmrth ’Tempera- 
jneni Scale during their training period and for each one a 
prediction of success on the job was recorded on the basis of 
these two tests. At the end of a year, 103 of these men had 
been discharged for proved violations of police regulations or 
of the criminal law. Of these 103, one had been rated “likely 
to succeed," 16 had been rated “chance of success doubtful," 
61 had been rated “likely to fail," and 25 had been rated “very 
likely to fail." Dividing the 16 predictions of doubtful chance 
of success in half, we have here accurate prediction in 91 per 
cent of the cases. 

In a third instance, 65 long-term employees of a company 
were given the Temperament Scale. The forms, identified 
by number only, were delivered to a technician who, from the 
Scale results alone, wrote a description of the temperament of 
each subject. These descriptions were then read to a group 
of long-term supervisors who attempted to name each subject. 
They were successful in 6a of the cases (95 per cent, roughly 
equivalent to a correlation of +.99). 

Recently we have reviewed reports from fourteen users of 
the Scale whose experience covered a period of years. ao,ooo 
cases were included. The weighted average indicates that the 
Scale afforded accurate reports of temperament in 93,5 per 
cent of the cases. 

We have not received any report of failure of the Scale in any 
situation where it was used as it was designed to be used and 
was used with due regard to correct procedures. 
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Ammons, R. B. and Hieronymus, A. N. “Critical Evaluation of a 
College Program for Reading Improvement," Journal of Eduen- 
tional Psychok^'y^ XXXVIII (1947), 449-470. 

All memliers of the entering class of 1941 at the University of 
Iowa were given a battery of five tests designed to measure reading 
rate, comprehensicm, etc. One hundreil and sixty-seven students 
scoring below the fiftieth i>ercentile on the Plommers Reading Test 
were given a special twenty-hour reading instruction course. A 
control group of 42 students were selected from the same population. 
Upon rete.stiiig, the experimental group showed significant gains 
over the control group) in three of the five tests, including the Blnm- 
mers Reading Test. There was a gain in reading late with no loss of 
comprehension. However, prediction of gain for individual students 
could not he made from the results of the study. The authors 
conclude that twenty hours of training can result in substantial gains 
in 'free’ reading. Dorothy Rtock 


Billingslea, Ercd Y. “The Bender-Gestalt: An Objective Scoring 
Method and Validating Data." Journal of Clinical Psychology, 
IV (i 94 «), i-a?. 

A.ssummg the original premise of the Bender-Gestalt test, that 
accurate visual-motor perceptual behavior is a skillful act involving 
sensory reception, central neural interpretation, and motor reproduc- 
tion, which may be distcirted bj' neural injurv, by variations in the 
intellectual level, and by maladjustments in the emotional organiza- 
tion, this study sees as its problem the quantitative evaluation of 
the amount of distortion in the figure reproduction, the discovery of 
the patterns which the distortions take, and the relating of these 
to the disturbances judged to be present in the subject’s personality 
organization. The experimental group consisted of 100 psycho- 
neurotic adult males; the control group of 50 males equated in 
intelligence, occupational experience, etc. Sixty-three indices were 
established to give quantifying coefficients to 25 test factors. No 
clear-cut reliability for the instrument was found. As regards 
validity, it is concluded that a clear syndrome for distinguishing the 
psychoneurotic test record has not been established, but that the 

' This is the last Mensurement Abstracts section to be edited by Professor Forrest 
A. Kingsbury, who retires from his professional duties nt the University of Chicago at 
the end of the present aeme.stcr. Professor King.sbury has given enthusiastic and 
faithful suppiort to IcDUCATiON ALAND PsvcTioLOotOALMEASuaEMENT ever since Its con- 
ception in 1940, and he hns made n substantial contribution to its usefulness. He 
leaves the .staff with the sincere thanks and hearty best wishes of the re.stof us. 

G. F. K. 
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tool can be of use for intuifivc jijHgnienfi of rhe dii-nir's dinical 
behavior. Sugge.stion.s for improved >.tandardiyatii!n and luiininis- 
tration are indicated. Gratitilk Pisher . 


Bradley, N. C. "The Growth of the Knowlfdgf rtf Tmiy in Children 
of School Age.” BrilUh Jourual ttf Psychnln^y, XXXVIII 11947), 
67-78. 

The aim of thi.s .study was to trace sn chililrcn the grov, rh of the 
ability to understand ordinary nmc-words and the dcvehtpnscnt of a 
concept of the universal and conrinurnis nature tif the tnne-sthemc. 
Results are reported for 4 tests administered tr» urban srhfwtl children 
aged 5 to 1,3, and indicate a general order rtf devdopment. Dis- 
tinctions between the present, past, and future are found to he 
established by the age of 5; the hrst tinic-words to Ik used following 
this stage refer to natural phenomena and iKTsonal activities or 
relationships, after which understanding is uchieverl of words more 
purely conventional in nature. Capacity to uiuierstanrl the enn- 
ventional time-.schcmc appears to Ive devdojK’d later than is generally 
believed, and this observation is of educational sigjiilieance, particu- 
larly in the teaching of history. Frances Smith, 


Brown, Andrew W., Morri.son, Joan and Couch, Ciertrude B. "In- 
fluence of Affectional Family Relationships on Character Develop- 
ment.” Journal of /Ihnormal and Social Psyehoia^'y XLII (tr;47), 
414-428, _ 

The subjects for this study arc a group of ten-year-olds and a 
group of sixteen-year-olds in a .small midwestern town. The first 
group was retested after three years according to a revised svsrcm. 
Questionnaires were developed to measure affectional family reiation- 
ships and character reputation. The correlations lietwecn these 
two factors show that affectional family relationships determine to a 
fair degree the type of personality a cliild will possc.ss. The area of 
family relationships most clo.sely related to character development 
is Sharing in Family Decision.s (the degree to which a ticmocratic 
atmosphere prevails in the home). Also important are Intcrparcntal 
■ Relations and Parental Attitude toward Peer .Activities. Dorothy 
Stock. 


Bruner, Jerome S, and Postman, Ixio. "Kmotional Selectivity in 

Perception and Reaction." Journal of Personality, XVI (1947), 

JNineteen subjects were presented with 99 stimvilus wmrds, .some 
of which were potentially emotional, and their reaction time was 
recorded, A. second list was made up for each .subject which in- 
cluded the SIX words yielding the fastest associative reaction time, 
me six yielding the slowest reaction time, and the middle six words, 
ihis list, presented two weeks after the first list, was used to measure 
speed of reaction. The results show a curvilinear relationship 
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between the two distributions. The authors believe that two func- 
tions combine to produce the results: an inten.sification of defense in 
the face of increasing emotionality (where a slow associative reaction 
time is accompanied by a slow rate of recognition), and a sensitization 
to tension producing stimulus objects (where a slow associative 
reaction time is accompanied by a very fast rate of recognition). 
The results show the equivalence of perceptual defense and associative 
blocking. Dorothy Stock. 


Cattell, Raymond B., and I.uhorsky, Ixster B. "Personality Factors 
in Response to Humor." Journal 0/ Abnormal and Social Psy- 
clwloyy, XTJI (km’j), 402-411. 

Believing that some of the more profound aspects of a man’s 
personality may be revealed by observing the things at which he 
laughs most heartily, the authors begin in this study an attempt to 
ascertain the constancy of humor appreciation, the primary tendencies 
to be found expressed in humor reactions, the effect of familiarity 
with the jokes, and (re.served for a future study) the 1 elation of the 
measured humor responses to measured personality factois and 
personal background. Using the responses of 50 men and 50 women 
to 100 selected jokes, 13 wdl-defined clusters appeared, an analysis 
of which resulted in five factois, believed to be general personality 
factors. -An attempt at serious interpretation of these factor.s is 
considered piematuic, but it is felt that they may prove to be of 
clinical and research v^aluc in the light of further study. Granville C. 
Fisher. 


Cocketf, R. "The Nature of Performance Tests: An Experimental 

Study." British Journal of Psychology, XXXVIII (1947). 29-38. 

The author performed four experiments (testing subjects’ per- 
formance on .specified manual tasks) in an attempt to find what type 
of activity a performance test requires in order to be reliable in the 
psychometric .scn.se. His first hypothe,sis was that a performance test 
requires some minimum degree of complexity before it can be reliable. 
Experiments i and 2 were performed to test this hypothesis, but the 
hypothesis was not .substantiated by the results. Experiments 3 and 
4 were then performed and the results yielded the conclusion that 
“a fundamental requirement in a performance test is that it must 
demand genuinely psychophysical activity throughout, i.e. . , . con- 
tinuous conscious guidance of bodily action." Sarah Counts. 


Dcemer, Walter L., Jr. "The Power of the t Te.st and the Estimation 
of Required Sample Size.” Journal of Educational Psychology, 
XXXVIII (1947), 3a9"342. . . 

The purpose or the paper was to review the concept of the 'power 
of a .statistical te.st and to develop a formula for use in determining 
the required .sample size to achieve a desiied power of the t test. Use 
of the t test may result in either one of two kinds of errors: (i) re- 
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jection of the null hypiithe*,ts when it is true; I2) acccpMmc rjf the 
null hypofhc.sis when it iv faKe. An ‘ern<r <.» the fir^t kind ‘ :s Huatded 
against by employing the usual signihcaiice levels, A method ss pre- 
sented for estimating, after an ('SixTsinent has Iwen jstTtormed. the 
probability of having comniitted an ‘error of the serond Kiml.' 
Another method is given for estimating m advanee the ‘ample size 
required to attain any given probability of rckw tjng the tnul! hypothe- 
sis when the probabilities of comniittmg Imtlt kisuK of erturs and the 
difference between means arc fixcil. Both suimsu’fncai and asym- 
metrical / tests arc considered. Kay C. Xfnn/^innmy. 


Ellis, Albert. “A Comparison tif the Use of Dircrt and Indirect 
Phrasing in Personality Questionnaires.” Psycimlo^tCM Mrjno- 
No. 2,84, 35 pp. 

Thirty-six most frequently used questions on eight -taiulard j>cr- 
sonality questionnaires for children comprise the basic perooiiality 
test used in tlii.s- study. Two direct forms and two indirect forms of 
the 36 Items were constructed, and administered to 40 behavior- 
problem boys and all non-problem Iwiys. There were three orders of 
presentation; indirect-direct, alternate, and direct-mdirett. 'the 
resvtlts suggest that (1) in order to encourage truthful responses 
indirect items should precede direct items; fiS each new mode of 
indirectly phrasing a series of questions may result m a sigmlicantly 
different instrument; (3) indirect tests do not difftTeiiMate probleiii 
from non-problem groups any liettcr than direct tests do, Inn mili- 
vidual Items may be inure discriminating when indirectly phrased 
than when directly phrased. Dorothy Stock. 


P'assett, Katherine K. “A Preliminary Investigation of the Sargent 

Test." Journal oj Clinical Psycholo^\\\\’ 56. 

Twenty-five women students from ’iK-ginnmg psychoiogy classes 
were given the original (S-form) of the Sargent 'Pest and 25 were given 
the experimental (X-form) of the tc.st. A rc-test was !ulininistercd to 
both groups six weeks later. The S-f<irm.s were scortal according to 
the original Sargent method; the X-forms according to the simplified 
experimental method. The author found that the tesf-retcst reli- 
ability of the d'ara'eHt Test is reasonably high foi a projectss e tech- 
nique. The X-form gives a larger sampling of conflict areas while the 
S-form gives a larger number of questions in the replies. The author 
concludes that the experimental .scoring .system has mitential value as 
a clinical device, Dorothy Stock. 


Fiske, Donald Vi^ ‘‘Validation of Naval Aviation C'afU’t Srlcctitm 
Training Criteria." Journal of /Ip pi led Psveho/oz}', 
aXXI (1947), 601-614. 

Pffiyoww/ Test devised by Woiuicrlic from the 
Uiis d-A Sest, the, Mechanical Comptehensiou Test constructed for the 
JNavy by Bennett, and the Biop'aphical Inocntory developed by Kelly, 
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used to screen applicants for Navy flight training, are reported on in 
terms of the correlations between each test and outcome of training. 
The Personnel Test was found useful m predicting ground school 
failures. The Mechanical^ Comprehension Test identified flight and 
giound school failures. The Biographical Inventory was best at pre- 
dicting flight failures. Gtanvtlle C. Fisher. 


Fox, Charlotte. "Vocabulary Ability in Later Maturity.” Journal 
of Educational Psychology, XXXVfll (1947), 482-492. 

\N'ord lists chosen from the English Recognition Vocabulary Test of 
Seashore and F.ckerson were administered to 30 subjects aged 70 to 
79, and to a control group of 30 subjects aged 40 to 49. Three 
methods of testing weie employed: group recognition (multiple- 
choice), individually adinimstered oral recognition, and oral defini- 
tion. No .significant differences were found between the two age 
groups, the definition task being significantly more difficult than the 
individual recognition task for both groups. Statistical analysis of 
half-credit definition scores for the two groups showed no significant 
difference in cpiality of definitions given by tlie older and younger 
subjects. Frances Smith. 


Hsu, E. H. "'I'he Rorschach Responses and Factor Analysis.” 

journal oj Genet al Psychology, XXXVII (1947), 129-13H. 

Detailed records were made of the Rorschach responses of 76 
children with normal IQ’s and an age range of 5 to 15. Plate I wRvS 
selected as offering thelargest number of common responses, and 15 
variables were chosen on the basis of respon.ses to this card, for compu- 
tation of intercorrelations. The variables included number of words, 
number of nouns, of adjectives, and of verbs, use of number, and 
total time, as well as specific common content-categories. Factor 
analysis by the centroid method and rotation of axes gave a factoi 
matrix of 7 columns. The psychological meaningfulness of 6 of the 
factors is discussed. Frances Smith. 


Jolles, Isaac. "The Diagnostic Implications of Rorschach’s Test in 
Case Studies of Mental Defectives.” Genetic Psychology Mono- 
graphs, XXXVI (1947), 89-198. 

Sixty-six children whose psychometric records indicated .seiiously 
retarded mental development were subjected to fuither study by 
means of their case histories and use of the Rorschach Test. On the 
basis of subsequent findings, they were divided into 3 groups; those 
whose Rorschach patterns clearly indicated normal mental ability, 
those whose patterns were inconclusive, and those definitely retarded. 
In comparison of the 3 groups an extensive overlapping in IQ’s was 
found. In each of the 66 cases Rorschach results showed severe 
emotional disturbance, while case history data revealed the impor- 
tance of family background in development of mental deficiency. 
It is emphasized that psychotherapeutic techniques as well as special 
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educational facilities should Iw utilised in tn-Atmeat nf the mentally 
deficient, and that psychometric examination ahme »h»eH not provide 
data for adequate study of the rctarilcd child. Frtincr,^ Smtih. 


Knauft, Edwin B. Cla^si^^cat^^n and Kvalnatson fif Personnel 
Rating Methods." ‘Journal of .ippHtd XXXI (11)47), 

6i7-“6as. 

In view of a felt need for more precise methods of evaluating the 
performance of workers, together with a lack of availahic joycho- 
metric precision in the rating incthods currently in use, the author 
pre.sent.s a classification of rating methods on the haws of (i) rhe 
operations performed by the cxiKiriincnter or scale maker in coii- 
structine the scale; (a) the tn>cratinns pcrformeil liv the judges or 
raters when applying the rating device to a given individual ; and (3) 
the operations involved in constructing .a .scoring methmi for the 
rating device, for the purpose of evaluating the various rating methods 
and understanding the assumptions underlying their construction and 
use, The aim is that of stimulating a more critical approach toward 
the many rating systems now in use. Gram-iilc C. fisher. 


Leeds, Carroll H., and Conk, Walter W. "The Construction and 
Differential Value of a Scale for Determining Teacher-Pupil Atti- 
tudes.” Journal of Experimental EJuunion, .W 1 (iv47), 149 159. 
The author.s report the construction of an attitude scale, the 
Teacher-Pupil Inventory, for gauging teacher attitudes towartl pupils 
and differentiating those teachers who get along well with pupils from 
those who do not. The inventory consists of i/')4 items, and requires 
20-30 minutes to administer. Its validity, as determined hy correlat- 
ing inventory score.s with the combinctl ratings of the principal, the 
author, and the pupils, was .59 for a group of 100 unselectcd teachers; 
Its reliability was .91. Data arc presented on the relationship 
between ", . . the attitudes of teachers toward pupils and certain 
personal data relating to the teacher . . and on . . an analysis of 
pupil’s reactions toward particular teachers." Kax C. Motifxomery, 


Lindgren, Henry C. "A Study of Certain Asix-cts of the Uc-'l'liorpe 
Occupational Interest Inventory." Journal of luiueatirmal Psy- 
chology XXXVIII (1947), 3 Sd-- 3 f‘^ 

Some aspects of the use and possible interpretation of the l«- 
Thorpe Occupational Interest Inventory were studied. I’he {‘ansible 
limitations of the Inventory are discussed by the author and he sug- 
gests that perliaps its he.st u.sc is as* an interviesving aid. 'riit: scores 
obtained by adult males on the Inventory (advanceil Scries) were 
OTrrelated with their scores on the KuJer Preference Record and the 
Gamma Test, Otis ^ukk-Scoring Tests of Mental J/nlity. Significant 
correlations were found Iwtwecn the Kuder and the' Inventory on 
comparable categories. The correlations Ixjtwcen the Otis Ciamma 
and the various scales of the Inventory were low, with the exception 
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of one — Level of Interests on the Inventory — which approached 
significance. Sarah Counts. 


Loevinger, Jane. "A Sy.stematic Approach to the Construction and 

Evaluation of Tests of Ability.” Psychological Monographs^ LXI 

(1947), No. 4. 

Thi.s study is concerned with the problem of the consistency of a 
test, the choice of subtests or items, and the unit of measurement, as 
these are related specifically to power tests of mental ability. Review- 
ing the concept of reliability, the author concludes that as piesently 
defined and used it is highly unsatisfactory. The problem of item 
selection is discussed and cunent practices are criticised. Thorn- 
dike’s, Thurstone's and Flanagan’s methods of scaling are evaluated. 
Developing the thesis that the solution to the above is inherent m the 
concept of homogeneity, the author presents a senes of theoiems and 
proofs, together with formulae for the mea.surement of homogeneity 
in a test, and homogeneity in test items. Criteria are offered for an 
adequate system of scaling. The author states that the subject of 
scaling is far from closed, no system having proved adequate by the 
criteria she proposes; the development of adequately scaled tests 
awaits the development of highly homogeneous tests. Granville C. 
Fisher. 


Moore, Thomas V., Stafford, John W. and Hsii, En Hsi. "Obverse 

Analysis of Personality.” Journal of Personality^ XVI (1947) 

10-48. 

Fifty-six women students rated themselves on 128 personality 
traits. Each person was correlated with each of the others in terms 
of traits commonly claimed or denied, or differentially claimed or 
denied. This analysis brought out nine factors, three of which could 
be identified as a cycloid factor, a schizoid factor, and a suspicious 
factor. A second analysis was undertaken after the 38 least differ- 
entiating Items were eliminated. This analysis brought out eleven 
factors : an adjustment factor, a romantic factor, a factor of inferiority, 
a factor that is not clear-cut, an extrovert factor, a frustration- 
romantic factor, a schizoid factor, a pre-psychotic "paranoid” factor, 
a jealousy factor, a factor not clear-cut, possibly an adjusted introvert 
type, and a pre-psychotic "simple or catatonic schizophrenia” factor. 
The authors conclude that the first type of analysis is most useful in 
ascertaining the homogeneity of a population, the second in analyzing 
configurations of traits. Dorothy Stock. 


Mummery, Dorothy V, "An Analytical Study of Ascendant 
Behavior of Pre-school Children.” Child Development, XVIII 
(1947), 40-81, 

Seventy-nine categories of ascendant behavior were classified 
according to social acceptability. Forty-two pairs of three- and four- 
year-old children were observed and rated. Seven of the twelve least 
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ascendant childien were gsvcii training in mastering txys; the remain- 
ing five constituted a control gfttup. A re-test slumeti that there was 
an increase in the total ascendant Inihavior and in the •••jcially aciept- 
able ascendant Iwhavior for the exjwriniefital group while the control 
group showed no consistent change. 'I'he .uithor tomluiks that 
encouraging an attitude of confidence m the child wnil lead to an 
inciense in .socially acceptable ascendant Itchavior wirhmit undue 
reference to the .status of the other chihi. Dwnlhy Stock. 


Portcus, Stanley D., and Peters, Henry N. "Nlare IVst \'alidati(m 
and Psychosurgery.'' Geneuc Vsychoh^^y Momjiraphs, .\XXVI 

(1947). 3 “S 6 

Fifty-five patients who had : ‘ iiny at the Kaneshe 

Plospital for the Insane, Island ‘ 1 ■■■■ ■ were dts'uled into 3 

groups on the ba.si.s of unimproved, improved, and greatly improved 
post-operative adjustment. Results for each group of pre-ojuirative 
and po.st-operative testing with the Portcus Test were coinpaicd. 
A significant decline in performance was found for all patients. 
When post-operative testings were rejwatcd, the 2 iiujiroved groups, 
though showing the greatest initial decline, were found to make larger 
subsequent gains, with the much improved group finally excelling the 
middle group. Whereas Binee-mc.asuretl functions have shown fittle 
change following lobotomy, the Maze Test conclusively shows scnsi- 
tivity to changes in the functions of planning and foresight . Frances 
Smith. 


Shaffer, Robeit H., “The Fjffect of Knglish Deficiency Uimn a Stu- 
dent’s Adjustment in College.’’ liuHctin of the School nj luiueotion, 
Indiana University, XXIV. i (194K), 34 pp. 

In this study students with a deficiency in Knglish arc compared 
with a matched group without .such deficiency in respect to scholastic, 
social and emotional adjustment. It was found that the deficient stu- 
dents passed significantly fewer houts of work and earned significantly 
fewer credit points than the non-deficient, the differences In'tween the 
^0 groups decreasing steadily from the first to the fifth semester. 
On the basis of the Bernreiiter Personality Incentory, the first semester 
deficient students were found to be (a) less ncumtic and more evenly 
balanced emotionally than the first semester non-dcficicius, (b) more 
extroveited and less apt to worry, (c) more dominant, (d) more .self- 
confident and better adjusted to their environment, aiul fej more 
sociable and gregarious. The non-deficient group became more 
extroverted, more self-confident, _ and more sociable than college 
students as a whole, while the deficient group hecamc less dominant, 
less conhclent, and less .sociable as they remained in college. More 
or the deficient than the non-dcficienc firsc-semester students were 
round to be participating iri group activitie.s. No difference was found 
between the two gioups with regard to (i) dates, dances, and shows; 
(,2; vocational choice having been made; (3) student’s own evaluation 
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of his adjustment; (4) pei.sonal or family piohlems, (5) idea and con- 
ception of a successful college; etc. The author offers some inter- 
pretations and implication.s of the data. Granville C. Fisher. 


Stiong, Kdward K., Jr. "Norms for Graduate School Business 
Students on the Minne.sota Vocational Test for Clerical Workers." 
Journal nj Applied Psychology, XXXI (1947), 594-600. 

In view of the erroneous interpretations which are made of the 
scores of the above test due to a lack of norms applicable to business 
men or students headed for business rather than clerical positions, the 
author supplies nouns on 16K male business students. He also 
supplies data to indicate that the test measuies ability to see differ- 
ences in number.s and names, rather than "the ability to discriminate 
small differences lapidly,” as is claimed for the test. Additional data 
suggest that there is a significant positive correlation between the test 
and intelligence except among a homogeneous group of clerical workers 
for whom the test is designed. Granville C, Fisher. 


Tilton, J. W, "The Relation Between IQ and Trait Difference as 
Measured by Group Intelligence Tests.” Journal 0/ Educational 
Psychology, XXXVlII 0947). 343-3 

Data were collected and analyzed for unevcnnc.ss or scatter on 
group intelligence tests. The bieakdown of the data was done by 
holding mental age constant and grouping against IQ. Mental ages 
from 8 to 15 were u.sed with special emphasis on the 10:00-11:11 
range The profiles for the bright children had the least amount of 
scatter while those of the dull children showed the greatest uneven- 
ness. No attempt was made to account for the relationship between 
IQ and unevenness. Sarah Counts. 


Van der Merwe, A. B. and Thcron, P. A. "A New Method of 
Measuring Emotional Stability." Journal oj General Psychology, 
XXXVII (1947), 109-124. 

This study investigates the value of the Goetz Finger Plethys~ 
mograph in measuring emotional stability. _ An independent estimate 
of emotional stability for each of 30 subjects was obtained through 
the administration of the Bell Adjustment Inventory. The correlation 
between re.sults for the Bell Adjustment Inventory and the Goetz 
Finger Plelhy sinograph was significant above the 5% level. The 
author concludes that the rate of reflex finger volume change is a 
valid measure of emotional stability (as tested by the Bell Inventory); 
that the rate of reflex finger volume differentiates between individuals 
who are emotionally stable and unstable; and that the Goetz Finger 
Plelhy smograph is a useful means of measuring emotional stability. 
Dorothy Stock. 


Vernon, M.D. "Different Types of Perceptual Ability." British 
Journal oJ Psychology, XXXvIII (1947), 79-89. 
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The discovery of apt>arent discrepancies iH-twecn scnoiry acuity and 
perceptual skill and of variations in ixTccptua! skill wjth tyjK* of task 
formed the basis for this .study, p air crew in training were 

presented by means of Imth tachistoscopic and non-tachi .toscopic 
techniques with varied trcrccptnal material, in .snmr of the tests a 
differential brightness threshold also Iwmg obtained. The results 
offerecl some indication of l general factors indurnemg iwrception, 
analogous to those isolated by Thursfonc. These are described as 
(i) the ability to perceive and to discriminate pure shajK* and pattern 
characteristics, which appears to lie related to the differential Imght- 
ness threshold, and (i) the ahility to make further interpretation of 
sensory and perceptual data m accordance with a ptcdcternmicd set 
or schema. Here, administration of inrdligence tC’.ts g.ave results 
indicating a relation.ship with such ability. Fi.tnff Smith. 


Weschsberg, P'loreiice Orin, mul .Sparer, Phineas J. “A .Statistical 
and Profile Comparison of a Hospitalized Tulwrculous (froup with 
a Normal College Group Using the Cornell Index " yt/u\;ml of 
Clinical Psychology, H' (1948), (>3-69. 

This study attempted to ascertain the efficiency of the Cornell 
Index "stop,” “neurotic” and total items in terms of their ahilitv to 
differentiate the personality variances in a hospiiali/ed j'itl>cu*iibni.s 
group of 100, from those in a non-ho.spitalizeil sample of itx> college 
freshmen, Using a newly devised tecnnic|ue of profile analysis, the 
authors found that on the whole, the Cornell Index, N.j, does not seem 
to show significant pensonality diffcrcncc.s Ijetw’ccii th<’ compared 
groups; that "neurotic” items ap^war to Iw more discnnimatmg than 
the “.stop” questions; that age is not significantly related to the scores; 
that the length of hospitalization has a low jmsitivc idationship with 
the neurotic score.s of the male patient; that' female patients score 
higher than male in most symptom categories. .‘V salient contribu- 
tion is claimed for the profile technique. (frainiHe C. P'tshrr. 
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PREDICTION OF PROPTCIKNCY OF ADMIN- 
IS'I’EATIVI- PKRSONNIsL FROM 
[’KRSONAL HISTORY DA'I’A 


J P (U’llYORn A>)i. ANnlU'W I, t'DMRKY 
University ol‘ Southern C.ilifornin 

Arrr.MPTS to select iulministrativc personnel by means of 
tests have not been as numerous or as successful as those in 
connection with other types of personnel. This can perhaps be 
attributed to the fact that administrative ability represents a 
varying complex of many different traits, few of which are 
easily isolated. The investigation reported here’ represents 
an attempt to apply a biographical-data technique to the task 
of measuring administrative ability. It was believed that the 
biographical-data method had nor previously been given an 
adequate trial in this particular field of personnel selection. 

The encouragement to try this method stemmed largely 
from the success with which it was employed by the United 
^States Army Air Forces (3, chapter ay) in the selection of pilots 
and other air-crew members. Although the resemblance be- 
tween these tasks and those of administrative personnel Is not 
great, both types of tasks are markedly complex. If the 
method could be applied to one complex task as a whole, it 
seemed reasonable that it might be successful for another. 

Of particular interest in connection with the Army Air Forces 
studies was their investigation of the effect of directions upon 
the validity of the biographical-data test. It was found that 
standard directions with no mention of penalty for falsification 
gave results which were equally as valid as directions threaten- 
ing severe punishment for falsifying the response. Directions 
which encouraged laxity In answering the questions gave dis- 

1 We are indebted to Dean Emery E. Olson and Profc.ssor John M. PfilFner, of the 
School of Public Administration, who made this study possible by allotting funds from 
a research grant; also to Dr. Pfiffner for his continued interest and support; and to 
Dr Paul E. Webb, E. C. Wiil.s, Raymond It. Poilich, and Elizabeth Sands of the Los 
Angeles Ci ty Schools, who cooperated in the study. 
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tinctly lower validity. These results are important in any 
consideration of a hioyraphieahdatu test for seleetiiig em- 
ployees, since the opportunity for falsification is areat in this 
type of test. 

Studies with life-insurance company employees have .shown 
that biographical-data item.s are uselul in ]>rcdicting .succe.ss in 
certain types of job.s. Several attemjit'. have been made to 
utilize other printed tests to measure administrative al)ility 
with at least some degree of SUCCC.SS. 't'hur.stone (X) found that 
the Social Scale of the Allport-V ernon Scale of Values differen- 
tiated among certain federal government admini.sirators. 
Maiidell and Adkins (5) obtained validity coefficients greater 
than 60 for a top management group of executives on such 
tests as the linguistic section of the JvtcricatiCmificil on Educa- 
tion Psychological Kxamuiatwn , a Civil Scivkc Cammissinu Cur- 
rent Events ‘Vest, selected items from an Interpretation of Data 
Vest of the Progressive Kducation As.sociation, an lulininistra- 
tive-judgment test, and an agcncy-urganizarion-and-per.sonnel 
test Mandell (6) reported that the United States t'ivil Serv- 
ice had obtained promising result.s with tile Kttder Preference 
Record. He believes that there is some evidenee in favor of 
tests of mental ability and for interest inventories. Strong (7) 
presented some evidence to suggest tliat tlifferenees in interests 
between administrators and others may l>e expected, Achard 
and Clarke (i) reported definite indications that the measure- 
ment of interests can contribute to the selection of supervisory 
personnel, They used the Vocational Interest Blank for Men 
(Revised), Form M, Scale CFS, with success and also the Otis 
Self -Administering Vest of Mental Ability, Higher Examination, 
Form A. Uhrbrock and Richardson (9) found tliat mental- 
ability Items were useful in differentiating between good and 
poor supervisors. A few biographical-data items were also 
helpful. These items related to age, schooling, confidence in 
blue-print reading ability, and military service. Mitchell (4) 
used biographical data in selecting saic.s manager.s. He found 
that better educated sales managers were more successful, but 
other items of biographical information did not prove to be 
effective. 
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Devclupmenl af a Biagraphical~Data In-joitory 

As it bus been used in the past, the fainiliiir application blank 
represents an attempt to use biographical data, usually infor- 
mally and unsystematically, in selection. Most of the research 
which has been done in various fields of personnel selection 
with such data has utili/.ed an ojicn-end type of question and a 
somewhat limiteti area of questioning. In the present in- 
vestigation, the intent was to utilize a large number of questions 
covering a wide range of biographical information. In addi- 
tion, it was decided that the questions should be put in mul- 
tiple-choice form so that adequate statistical analysis of the 
results could he carrietl out. This feature of the test also pro- 
vided for the use of standardized answer sheets and machine 
scoring. In this way much of the labor was eliminated, both 
for the subjects and the investigators. 

The biographical-data booklet in its Hnal form was a four- 
teen-page printed booklet containing 150 multiple-choice items 
The items may lie loosely classified into four different types: (i) 
childhood background and family life; {2) professional prepara- 
tion; (3) health; (4) interests; and (5) early signs of leadership. 

The items of the first group involved information concerning 
occupations, interests, and social activities of the parents, social 
habits as a cliild, and happiness of the early home environment. 
It was believed that the character of the home environment 
might do much to influence the development of those traits 
which are important in administrative ability. A sample item 
of this type was: 

18. During most of the time before you were 16, you lived: 

18 — A With both parents. 

18 ~B With one parent. 

18 — C With a relative. 

18 — D With foster parents or non-relatives. 

18 — K In a home or m-stitution. 

The second group included items concerning the amount of 
education completed, types of subjects studied, scholarship and 
awards, major academic interests, and previous types of em- 
ployment. Previous work with biographical data had in- 
dicated that amount of education was of value in the selection 
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of administrative personnel, so it was hoped that these as well 
as similar items might he significant. A sanijilc item of this 
type was ■ 

47. As a college student, ytm were: 

47“ -A A Phi Beta Kappa. 

47 — B A Sigma Xi. 

47— C Graduated with honors, (But not 47 .A or Hi 
47 — D A good .student. (But not 47 A, B, or Cl 
47-- E An average student. 

The third group of items concerned the liculth of the in- 
dividual, both as a child and as an adult. 'I he ailministrator 
is generally believed to be a person of excellent health and con- 
siderable energy. It seemed likely that individuals indicating 
a history of less than average health might prove to he poor ad- 
ministrators. A sample item of thi.s type was: 

25 Between the ages of 12 and 2t, liow often were you suffi- 
ciently ill to recpiiie hospitalization? 

25 — A o. 

25— -B I. 

25 — C 2. 

25 "-D J' 

25 — K 4 or more times. 

The fourth group ot questions included a large number of 
items relating to interests, types of recreation enjoyed, reading 
habits, motion-picture and entertainment preferences, and 
social habits. In view of the .suggestion of previous research 
that interests may be of value in the selection of administrators, 
it seemed important to include items of this type. .A sample 
item was- 

14T. What type of radio program do you prefer? 

T41 — A Classical music. 

1 41 — B Dance bands. 

1 41 — C News commentators. 

141— D Plays. 

1 41 — E Comedian.s. 

The fifth, and final, group of items was devoteti to questions 
concerning early signs of leadership, Since administrative 
work involves leadership in most cases, it wa.s believed that 
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individuals who were leaders in their childhood and adolescence 
might later become good adininistratois. A sample item was: 

^';5. How often weie \tui a leader of your childhood “gang" 
activities up Co tlic age td 12 years'' 

35 -A Alway*. 

35- B I'Veiiueiirly. 

35 — C (JccaMonally. 

35 I) Seldnin or never. 

35 - 1 ''. (’You were not ;i incinlier of a gioup, or you can’t 
reiiK'niber). 

M-any other heterogenetiu.s types of cpiestions were included 
which cannot properly be placed in one of the four mentioned 
group.s. For example, one item wa.s-; 

101, Youi own per sunahtv most resembles that of your: 
loi— A Fathei. 
lot- B iMofher. 
tot- C Brother 
tot I) Sistei. 

lot K (None of these or you iloii’t know). 

Certain type.s of items were omitted because it wuis felt that 
they might prejudice the subjects against the re,search and 
hence do more harm than good. Questions pertaining to race, 
religion, and very personal matters were not included. 

/ (em - J 'aUd(itio)i Procedures 

The original sample included all of the regular principals and 
vice-principals of the Los .•\ngcles City BchooLs. These fell into 
three groups, elementary, junior-high, and senior-high school 
principals. In preparation for the administration of the test, 
one of the investigators talked before most of the principals in 
the elementary- and junior-high-school groups to explain the 
purpose of the project, and to as.surc them that the information 
obtained would not be utilived by the scliool system for pur- 
poses of evaluating individual principals. It did not prove 
possible to offer this same type of orientation for the senior- 
hlgh-school principals. 

The biographical- data booklets were enclosed individually in 
an envelope together w’ith an instruction sheet, a standard ans- 
wer sheet, and an electrographic pencil. One of these 
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envelopes was then distributed via the (ifiicial intci -school 
mailing system to each one of the principals to be fillcal out and 
returned. The principals weie also instructed to return the 
booklets in sealed envelopes through the inter sclionl mail. It 
would have been most desirahlc to have had the principals fill 
out their answer sheets in supervi.seil group.s. This kind of ad- 
ministration of the test was regarded as not fea.sihle by the 
school authorities. 

Returns from the senior-high principals numbered only 37, 
which constituted only a fraction of tlie total numlier tn that 
group. For this reason, the results for that group were not 
analyzed. The elementary and junior-high groups were com- 
bined to be treated as one group, Of this combined group, 328 
principals returned booklets, which constituted a return of 93 
per cent. A few of those who did not return luioklet.s were ill; 
the remainder either refu.sed to turn them in, or ignored re- 
quests to do so. It was felt, however, that the remaining seven 
per cent of the cases not included in the analy.si.s would not 
materially alter the results. 

The 328 cases which constituted the final sample were sub- 
divided into Groups A, B, and C. Group A was composed of 
122 female principals selected at random ; Ciroup B included the 
remaining 123 females; Group C was composed of the Hj males 
included in the total elementary and junior-high .sample. The 
female cases were separated into two groups so that a compari- 
son could be made between the results of the analysis in one 
group and those in the other to obtain evidence as to whether 
any significant correlations obtained were not due to sampling 
errors. It was also planned to make a cross-validation study, 
i.e , derive a scoring key for valid items in one group and esti- 
mate the validity of the total score in the other group. In view 
of the item-analysis results, this step proved to be unnecessary, 
The men were put in one group because there were not enough 
of them to make up two groiqi.s. 

The answer sheets filled out by the principals were divided 
into six groups, according to the divi.sion of the principals into 
high and low halves for each of the Groups, A, B, and C, Then, 
a scoring-machine tally was made of every response, for each 
alternative answer to every question for each of tliese six groups. 
For example, in question one, with five alternate answers, we 
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might find flmr j:) individuals in the high group and lo in- 
dividuals in the low group of Group A had marked the space 
corrcsp(jnding to alternative i-A. For Groups E and C, dif- 
ferent tallies would occur. 

With 150 questions, each with five alternative answers, a 
total of 750 categories were tallied for each of the six groups. 
Then, a correlation could be computed for each response for 
Groups A, E, and C separately. Thus, 750 correlations were 
possible for each of the three groups, or a total of 22,50 correla- 
tions for the entire study On the basis of visual inspection of 
the differential frequencies, plus previous calculation of the dif- 
ference in frequency required for approximate significance, 
many of the correlations' could be eliminated u.s being definitely 
below the level of significance. For the remaining ones, phi 
coefficients were computed, using an abac provided by Guil- 
ford (2). 

■The Crinrio}/ 

One of the greatest difficulties in studies of the selection ol 
administrative iicrsoimd is to decide who is and who is not a 
good admini.strator. 'I'liis was perhujis the greatest difficulty 
and the weakest point in this research. 'Fhe problem with 
which wc were confronted was to diviile each of the three 
Groups A, E, and C into two halves, higher and lower, with 
respect to administr.itive ability. 

The only information available for this purpose consisted of 
the periodic ratings made by the school system for purposes of 
promoting principals lo the next higher salary groups. This 
particular problem was studied foi some months prior to the 
mailing of the booklets to sec whether the ratings were of suf- 
ficient reliability to warrant a study. It was decided that the 
ratings exhibited sufficient I'eliability to enable us to carry out 
the research, but no determination could be made with respect 
to tlie validity of these ratings. 

The ratings of each principal are generally made in- 
dependently l)y three or more superintendents. There is a 
definite possibility that the basis upon which superintendents 
rate individual principals may be colored by something other 
than their administrative ability. 

Many difficulties arose in connection with the evaluation of 
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these ratings. The elementary principals were rated in itronps 
generally by means of a rank-order teclinitjm*. in which each of 
approximately four superintendent.s arranged in rank order a 
stack of filing cards, eacli of w liich iield the name of a pi incipal 
being considered for pronioiion. The secoiulary or junior-Iiigh 
principals were generally ratetl on a fi^•e-category uraphic rat- 
ing scale with a spread of ico jinints for each catca.ory. Thc.se 
categories included such traits as success in coinimmitv rela- 
tions, ability as a manager, succc.ss witli personnel, and the 
like, A study of the intercorrelations between traits showed 
that a pronounced halo effect was operating, hence an average 
of the five different categories might just as well he u.scd. 

The difficulties wnth these ratings included the following ones, 
among others which we may have overlooked. The jwincipals 
in Group A, for example, had not all been rated by the .same 
superintendents, hence no satisfactory ha.sis cxi.sted for com- 
paring each principal with every other principal. ITirthermore, 
some principals had been rated several time.s over a period of 
years while others had been ratetl only once, or not at all. Fur- 
ther, a comparison was made necessary between principal.s who 
had been rated on a graphic scale and those who had been rated 
by a rank-order method. 

The problem of determining the reliability of the.se ratings 
proved even more of a dilemma. In order to estimate the re- 
liability of the ratings, either different rater.s on the same in- 
dividuals should be compared, or the same rarer at different 
times, or both. These procedures require having data for all 
principals rated by the same superintendents on different oc- 
casions. Since only a few of the principals in a group had been 
rated in such a manner, it was very difficult to make a deter- 
mination of the reliability. 

In an attempt to get around these difficulties, the following 
simple procedure was used. A list of all the principals in each 
group was made. Kor every occasion on which he had been 
rated, the principal was given a relative position in comparison 
with the other principals rated along with him. That is, on 
the basis of an average of all his ratings, whether rank order or 
graphic rating scale, every principal in the particular group 
being rated at the moment was given a rank-order number. 
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This number was translated into a per cent position by the 
following formula- 

Per cent Position — • 

in which R is the principal’s tank-order number and N is the 
number of individuals with whom he is being compared in that 
particular group. Each per cent position was then converted 
into a score from o.o to lo.o in which 5.0 is approximately the 
mean It was assumed that the individuals in each group were 
normally distributed with respect to the cpialities rated and 
that the mean proficiencies of groups were actually much alike 

For those principals who had not been rated pieviously, 
special ratings were obtained and treated in the same mannei 
described above. After all this manipulation of data, a list 
was available in which every principal had a numerical value 
beside his name which wa.s roughly comparable with the num- 
erical values of every other principal. In order to obtain one 
final representative score, an average was computed of all the 
scores for a [principal, so that finally, one score for each principal 
was obtained. 

In order to make an estimate of leliability, it was arbitrarily 
decided to include all principals who had been rated at least 
twice, 'fhen, the first and last tabulated rating for each of 
these principals was taken. A phi coefficient (corrected for con- 
tinuity) between these first and last ratings for 242 cases was 
.66, which was significant beyond the one per cent level. 

In each of the three groups, A, B, and C, a median of the 
composite rating scores was determined. On the basis of these 
medians, the principals in each group were divided into higher 
and lower halves. 


Results and Conclusions 

Frequency distributions of the phi coefficients of significant 
size are given below. The levels of significance given were 
determined by reference to chi-square values, converted to cor- 
responding phi coefficients. Although the uncorrected phi co- 
efficients were used in determining their significance, the coeffi- 
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cients in this table, and below it, have been corrected for 
continuity in one variable ’ 

The 86 statistically significant responses listed in Table i 
were distributed among the three groups as follows: (i) 24 re- 
sponses weie significant in Group A only; (2) twelve responses 
were significant in Group B only; (3) thirty responses were 
significant in Group C only; (4) four resptmses were significant 
in the same direction in Groups B and C‘; (5) one response was 
significant in the same direction in Crroups A and C ; (6) two re- 
sponses were significant in the opposite direction in Groups B 
and C; (7) one item was significant in the opposite direction in 
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Groups B and C; (8) no response was significant in the same 
direction for all three groups; (9) no response was significant in 
the same direction for Groups A and B, the two female groups; 
and (10) a total of 57 items were involved in the H6 significant 
correlations for the three groups combined. 

An analysis of the 57 significant items by uroujis reveals: 
(i) fourteen were significant in Group A only^ (aj nine were 
significant in Group B only; (3) twenty were .significant in 
Group C only; (4)^ five items were significant in CJroups A 
and B. Of these rive items, the alternative re.sponsc results 
agreed substantially in one, disagrectl in two, and neither 


ol correction rest!, on the nssiimjuinn that the truerltin is nctnally 
^'^Prcwnts ogerationdlly .1 (ximt tlistrilnition. 
ine corrected coefficient should be numerically equivalent to a {loinc-biscrial r. 
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agreed nor disagreed in the other two; (5) five items were 
significant in both A and C groups. Of these, three were in 
agreement in the two groups, and two responses neither 
agreed nor disagreed; (6) tlirec items were significant in Groups 
B and C. The responses in these items were significant in 
the same general direction in both groups; and (7) one item 
resulted in the same trend in all three groups. 

Responses within items which reached the one per cent 
level of significance in Group A were: (i) participation in 
mild sports (golf, hiking, etc.) occasionally, phi == -.33; 
(a) piarticipation in mild sports (golf, hiking, etc.) seldom, 
phi = 35, (3) participation in collecting (stamps, coins, 
antiques, etc) frequently, phi — —.35; (4) between the ages 
of 12. and 18, belonging to an organized group of children of 
own age without adult sponsorship, phi — .31; (5) other than 
school work, reading during a large part of your free time 
between ages of 12, and iH, phi - —.31; (6) participation in 
making speeches frequently, phi — .31; (7) associating socially 
as a general rule with people younger than yourself, phi - 
-.29. 

For Group B, the following responses were significant at 
the one per cent level: (i) if the cost were the same, you would 
prefer to travel across country for pleasure by private auto- 
mobile (rather than by bus, airplane, etc.), phi = -.38; 
(2) as a child, you confided most in a brother or sister, phi — 
.31; (3) you succeeded well in history as a college or school 
subject, phi = “.30. 

Responses reaching the one per cent level of significance 
in the male group were- (r) prior to the age of 21, you lived 
most of your life in a large city (over 500,000), phi = .46; 
(2) you learned to swim at age 10, or below, phi = .35; (3) 
between the ages of 12 and 18, you belonged to the boy scouts, 
phi = .40; (4) you succeeded exceptionally well in history as a 
school or college subject, phi = .63; (5) you succeeded ex- 
ceptionally well in psychology as a school or college subject, 
phi - .35; (6) participation in gardening occasionally, phi ~ 
.50; (7) participation in travel frequently, phi = —.44; (8) you 
arc occasionally interested in making things, shop work (with- 
out necessarily having done so), phi = ,38; (9) you are fre_ 
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quetitly interested in camp cminscllinu. \MCA ur ^ WCA 
work (without necessarily havinit participated!, phi - -.3S, 

(10) yourpresentweightis lyoto lit*;, phi -- .37. 

From the eight items whicli gave significant results in the 
same general direction for at least two of the three groups, 
the following information is suggested: (i) the successful 
administrator’s father generally employed mote than five 
people; (^) confiding during childhood in the mother is not 
so auspicious as confiding in a hrother or sister; (3 j a child who 
when ill is put to bed, hut with medication is more a[>t to be a 
successful administrator than if he had a physician called, 
had only home remedies, was merely kept at home, or had no 
special attention; (4) liclonging to an org.tniaed group of 
children between the ages of 12 and is worth while; (5) suc- 
ceeding well in history us a school or college subject seems had, 
but succeeding exceptionally well seems v-ery good; (h) suc- 
ceeding either well or excepdonally well in psychology as a 
school or college subject is not ih'sir.ihle tor a lemale adminis- 
trator, whereas succeeding exceptionalh well in psychology is 
good for a male administrator. Init only succeeding well is 
undesirable; (7) individuals who would like to h,ive four or 
more children are not likely to be good ,-ulminisrr.itnr.s; and 
(8) those who were 40 to 50 years of age teiulcd to be r.ited 
better as adminivStrators, while those over (r; tended to receive 
poorer ratings. 

In evaluating tlie significance of the results on an over-all 
basis, two appro,aches could he adfipted: (1,1 ;i comparison 
of the number of significant respujist's in each group and in 
all three groups combined with the number of i-e.sponses 
which would be expected to reach a standard of signific.ance 
by random sampling among re.sponses that actually correlate 
zero with the criterion; {%) a comparison of the number of 
items which contained at least one significant re.sponse with 
the number of items expected by chance, consitlering each 
group separately. Neither of the.se ajiproaches is completely 
satisfactory, as will be pointed nut. 

The first approach reveals a total of H6 respon.sc.s out of 
2250 to correlate significantly at or beyond the five per cent 
level, Slightly more than 100 significant responses would be 
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expected if the normal sampling situation could he applied 
in this manner. Since tlie respontlcnt is forced to choose 
only one of five alternative re.sponses to an item, the 2250 
judifmcnts were hy no means independent. For thi.s reason, 
the first aj'proaclt docs not appear to he applicable. Because 
of the interdependence of respon.ses, mostly in the form of 
negiitii'C correlation, a .smaller number than 2250 should he 
used as the base; how much .smaller is not known. 

The second approach, evaluating the significance of the 
items as a whole, is prtihaldy the better of the two methods. 
If any response in a particular item demonstrates significance, 
that item as a whole may he considered significant. With a 
total of 150 independently answered items, approximately 
eight would he expected to yield correlations which equal or 
exceed the 5 per cent level of significance. Actually, 25 
items were significant hy this criterion in (Iroup A, 18 in 
Group B, and 29 in CJroiqi C. This would suggest that a test 
composed of the significant items would have a predictive 
value significantly better than chance. While by this pro- 
cedure tliere wouhl .seem to be a marked excess in the number 
of significant items for each group, there is at least one qualify- 
ing thought to detract from this conclusion. The items 
themselves are probably not independent. Just how the 
item intercorrclations may affect the number of items meeting 
the criterion of significance by chance effects alone is not 
clear. Since the item intercorrclations are probably positive 
(in the sense of the association of “good” features), chance 
factors might be expected to increase the dispersion of phi 
coefficients and tlwis to produce more than the normally 
expected number of significant items. 

We are consequently forced to give attention to the com- 
parison of item phi’s obtained from different groups. There 
was not sufficient agreement among the results from the three 
groups with respect to the items which showed significance to 
warrant much optimism. Only eight of the 57 significant 
items showed agreement in at least two of the three groups. 

The results of this study do not bear out previous findings 
with respect to the value of present interests for the measure- 
ment of administrative ability. There is a slight indication 



294 EDUCATIONAI, and J>.SYC-Hf)J.Or,K'Al. Mr.AsXiRr.MI.N' r 

that early environmental data may he sufficiently useful to 
warrant further investigation. The items used did appear 
to select male school utlminisrrator.s sHglifly more effiectively 
than female administrators. Thi.s miuht indicate that female 
administrators in scliools are a mrirc homoifenetjus grmip than 
the males, or that biographical influences are not as uniformly 
effective with rc.spiect to administrative qualitic.s in women. 

A number of pos.s'ihle conditions might have accounted for 
our failure to obtain promising results, Kir.st, it might be 
that the items which were utilized were not sufficiently in- 
clusive to reveal the areas of biographical data which would 
give the best results. Secondly, the .school [U incipals who 
participated might not have been truthful in giving their 
answers. It was mentioned earlier that one group had to be 
eliminated from tire study because so few jirincipals returned 
their booklets. If the other two groups merely returned the 
booklets without giving careful attention to their answers, 
the results would be invalidated. In view of the findings in 
the Army Air Forces study previously mentioned with respect 
to truthfulness of responses, luck of vciacity does not appear 
to be a likely hypothe.sis, however. 

A further consideration of importance is that of criterion 
validity. If the ratings upon which the division of the prin- 
cipals into higher and lowci groujcs was maile did not lugipen 
to represent real variations in administrative ability, it would 
not be surprising if negative results occurreil. 

The reliability of the criterion was sufficiently low to result 
in obscuring a definite relationship, if it hapjienetl to he one 
of low correlation. In such an instance it would he imjiossible 
to conclude that no real relationship exi.sts. 

Assuming that none of these considerations actually was 
responsible for the di.sappoinliiig re.sults obtained in this 
study, the problem of generalizing to other tyjies of admin- 
istrators and even to other groujis of principals remains to be 
considered. In order to apply these results to other groups, 
we must assume that such udministratur.s utilize the same 
types of traits for success in their work as the school principals, 
as rated, in this sample. This problem cannot he solved 
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except through further research with the biogiapliical-data 
technique using other groups of administrators. 

Realizing that so many variables arc involved in the results 
reported here makes it difficult to draw any conclusions A 
review of the results, however, definitely points to the con- 
clusion that the biographical-data method has questionable 
value for the selection of school administrators. A reasonable 
presumption would be that this conclusion extends to similar 
information obtained in application forms or in interviews, 
or at least casts suspicion upon that information. 

Suirtmary 

An attempt to develop a personal-history inventory for 
the selection of school administrators i.s described. A 150- 
question, multiple-citoice type, inventory was given to more 
than 300 school principals and vice-jirincipals, An item 
analysis was conducted in which responses to various items 
were correlated with success as a principal, measured by 
promotional ratings. Although a significant number of 
correlations was obtained separately in each of three groups 
of these principals, good agreement between the groups was 
obtained with only eight items. Possible explanations of the 
results were reviewed 1 1 was concluded that the biographical- 
data method has only limited promise of usefulness for the 
selection of school administrators. 
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SUPERVISION OF COUNSELING SERVICES^ 


K. a, WILLIAMhOX 
Univcrtiiy of Mitinewtu 

Majot Obiectives of Supervision 

Improving Service There arc three major objectives of the 
phase of administration known as supervision, two of which are 
more important than the third. One is the maintenance of 
continuously improving service to veterans, and I would stress 
the fact that it must ^o spirally upward, not remain static in that 
it reaches a certain level of cfFectivcne.ss and then tapers off. 
Thinking back to the periiul following World War I we get 
perspective, At that time our knowledge of counseling was 
very rudimentary, and we would no more think of fixating at 
that level than we would think of jicrmitting metlicine to 
operate at the level of understanding of that day. 'I’he whole 
world has moved on in terms of a better understanding of the 
processes of effective counseling. I know there are some con- 
cepts of administration which fixate effectiveness at a particular 
level and maintain it, That is simply not possible in a world 
of human beings. If we had a world of machines, we could 
fixate at a particular level, but in the case of a profe.ssional 
service such as counseling we go backward or forward. 

Developing Counselors. The second major objective Is a 
little unusual for an administrator to be talking about. It is 
the continuous personal development of counselors themselves. 
This is an extremely important part of administration and 
much research is needed concerning the personnel problems of 
personnel workers. Why? Hccausc the counselor is the in- 
.sLruincntality through which counseling is achieved. He is 
the only effective means by whidi counseling is achieved. 
All of the rituals are only half as important as the personality 
of the counselor. We keep forgetting this because adminls- 

‘Thi.s article is an adaptation of a talk given on January o, 1948, in the Minne- 
apolis Regional Office Advisement Program, U. S. Veterans Administration 

597 
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tratloii has been cast in the mold of a rigki structure, just as 
certain concepts of engineering are cast in a rigitl mold. Coun- 
selors are constantly subject to environmental pres.sures, and 
sometimes these pressures interfere with the maintenance of a 
high level of effectiveness. The counselor himself i.s often as 
much in need of counseling a,s the clicn t is, and any admini.stratnr 
that forgets it is not being a good administrator. It .seems so 
axiomatic that it .should be unnecessary to state it, yet in ad- 
ministration we almost refuse to do for the doctor wliat a 
doctor does for his patients. It is as though we coun.sclor.s were 
a race apart without any problems There is no other profes- 
sion where there is ?i perfect fitting of worker and work, and we 
should not expect it of counseling, hut we often do, and this is 
a part of supervision that is most .seiiously negleftcd. The 
old adage of “Physician, help thy.self’ is not often applied in 
the administration of a personnel jirogiam 
Controlling l^nnlity. — 'I'hc third objective of evaluation and 
supervision is of less importance, in my judgment. The so- 
called administrative quality control is less import.uu as a 
direct object perse. We don’t achieve it directly for one simple 
reason: counseling is a professional .service, and quality in a 
professional service is best achieved by treating practitioners a.s 
professionals and by stimulating them and leading them to the 
desire to improve themselves. 'I'hat is the way we get quality 
control, and not by setting up dcvicc.s to see how many letters 
they have on their desks and all the other claptrap machinery 
by which one traps little people through administrative devices 
of one sort or another. An administrator has a hard time 
learning that the way to achieve quality is to give the profes- 
sional plenty of elbow room, to let him use his imagination, 
and not to put him in a procedural strait jacket. If the 
counselor does not have imagination, nothing will substitute 
for the missing imagination, and it does little good to set up a 
manual of pioccdures. But we are still constantly trying to 
set up manuals of procedures to suh.stitutc for a lack of profes- 
sional qualities, and without success. Given the professional 
capacity, procedures do not need to he written too specifi- 
cally because the professional worker i.s able to adapt himself 
to the need of the client he faces. 
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To recapitulate, the three major objectives of supervision 
are: (i) the maintenance of continuously improving service to 
the veteran; (2) the continuous personal development of counse- 
lors themselves, because they are the instrumentality through 
which we achieve the first objective; (3) a quality control 
through treating counselors as prtjfessional workers I will 
derive a number of generalizations from these objectives. 

Methods oj Supervision 

Now we will turn to the methods of evaluation and super- 
vision. I have tied up the two phases, evaluation and super- 
vision, for particular reasons. If we are not dealing with 
professional service we do not need the concept of evaluation. 
All we need to do is to supervise the worker to keep him on the 
job When wc deal with the professional service, we need to 
emphasize evaluation because supervision has come to be a 
type of surreptitious searcliing for means to keep people’s noses 
to the grindstone. 

I shall discuss four methods of evaluation and supervision. 
I should preface my discussion by saying that I have in mind a 
particular kind of organizational setup, and some of these 
methods may not be particularly relevant to every situation. 
I am talking about general methods, and obviously many of 
them will have to be adapted to fit a particular situation. 

Consultations -The first method may be described as non- 
regular consultations with a superior officer initiated by the 
counselor himself when he feels the need for aid. That is an 
ordinary state of relationship between professional workers. 
When a counselor feels something is out of his competence, he 
goes to his superior officer for aid through consultation. Now, 
the term consultation is not widely enough used in counseling 
circles. It is the conferring of two professionals about a situa- 
tion that is not clear; it is the borrowing of ideas from equals, 
the exchange of relevant experiences. Please note that there is 
no implication of a loss of status on the part of one who seeks 
such a consultation. Moreover, there is no implication that 
he is disqualified for his job because he does not know all the 
things he ought to know. The technique of consultation is 
based upon the concept of professional ignorance which arises 
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out of the fact that one man spcciali/.c.s in what another man 
may not know, and that it is impossible for any one man to 
know all of the needed specialties. Therefore, these individuals 
of equal but different specialties confer aiul consult with each 
other to borrow services and to e.Kchange idea.s. 

We ought to consult each other more frequently in counsel- 
ing because wc are in danger of developing the concept that 
a counselor should know everything when dealing with a par- 
ticular client. 

That should be all-suflicicnt. But common observation 
indicates that no matter how able the coun.selor is, he can never 
know all he ought to know to deal with any one client. There- 
fore we should abandon the idea of self-sufficiency in terms of 
technical background and understanding, and instead borrow 
the concept of consulting from medicine. But we have not 
developed yet to this sophisticated level of practice. If we 
can thus develop, wc may consult with any superior officer 
about a particulai case without having the .superior officer 
think, “Why doesn’t lie know what he should know?" 

Non-regular consultations with a svqiervisor whenever we 
feel the need for aid may lesult from uncertainty td’what diag- 
nosis we should place on a particular ease. All counselors are 
uncertain at times, and all have pu/zling case.s because there 
actually arc puzzling cases. This is a fundamental generaliza- 
tion that a counselor ought to keep clearly in mind We ought 
to be impressed with the infinite capacity of the human animal 
to get into complex .situations and difficultie.s. And our 
knowledge about his complexities fills only a little thimbleful 
in comparison with the huge re.servoir of his latent capacity. 
Therefore, it is inevitable that many counseling cases are 
beyond our understanding. And if we do not recognize this 
truism, then there is something wrong with us us counselors. 
If we think we have all of the possible causes neatly pack- 
aged and labeled, then we are concealing the truth from our- 
selves. What counselor is not uncertain of many of his di- 
agnoses ? 

Such a feeling of need for aid may also stem from a sense of 
uncertainty about the desirable outcomes of counseling for a 
particular individual. After all, in the way this world is 
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organized tliere is more than one mail leading to Rome, and 
there is more than one tiiinu that the idicnt can do to get out 
of his current difficulties. Indeed there is often more than 
one occupational outlet lor him. There is more than one type 
of training possible for him. There is more than one way to 
solve his maladjustment problem. I believe that any system 
of counseling which teaches counselor.s that there is a sole 
standard solution to any human problem is ridiculous 

and is based upon a simple-minded concept of human nature. 
Just as the capacity of the human being to get things fouled up 
is infinite, likewise hi.s ways of getting them un-fonlcd are also 
infinite, and tlrat is one of the beauties of the profession-- -it is 
an art in that there arc many way.s of helping the individual to 
solve hi.s problems. 

Parenthetically, we counsclor.s and counselor-administrators 
need to be wary of trying to petsuade people to follow standard 
solutions. We arc always “solving" a client’s problem with 
the dictum:* “the manual says . . . But we fail to perceive 
that manual writers in fa roff places arc always trying to confine 
reality to the narrow molds in which they sometimes think. 
If they do not think of techniques and solutions then, they arc 
not important enough to think of. I'hat seems to be the 
implicit assumption of a few manual writers, In contrast, I 
believe that there should be elbow room in counseling for the 
uscof new ideas. No counselor should takeaway from his client 
the joy of inventing new ways of working out his own prob- 
lems and no supervisor sliould deny such an inventive experi- 
ence to any counselor. 

If we apply such a principle to the supervision of counseling, 
then we sec that a counselor may wish to comsult his associates, 
because of some turmoil in answering a query or in giving un- 
certain advice to a client. The counselor may say to his su- 
perior, “That is the way thi.s strikes me. What do you think 
about it? Will you check the information for me?" That is 
the kind of language that should be used between two profes- 
sionals — one superior administratively, but equal profes- 
sionally. Or the counselor may seek advice and aid because 
of a conflict of several possible actions or diagnoses, all of them 
equally plausible to him. Now, what counselor has not faced 



302 EDUCATIONAL AND PSYCHOLCKDC/VI. MF. AnURDMENT 

the situation in which he can say: “It is either this, or this, or 
this? I can’t sec any difference between them.” He knows 
very well that all [Xissibilities cannot be right; therefore, there 
has to be a process of elimination, and there arc days when 
neither the counselor nor the client can select from among 
several possibilities. Therefore, he needs consultation, the 
help of professional equals. 

Case Reading- -The second mcthotl involve.s the careful 
reading of case histories, records and forms, The individual 
cases to be thus reviewed are selected and read by a designated 
staff assistant or superior official. The reading may cover a 
random selection of cases with regard to time or number, or 
type of case, or it may be a systematic selection of cases coun- 
seled on particular days of a week. I wouUl rather favor the 
systematic selection in a rotation sense so that in a month’s 
time the case reader would have covered every cnun.sclor and 
every type of case, such as rehabilitation involving particular 
kinds of disabilities, or a systematic review of type.s of occupa- 
tional adjustment. But, on the tither liand, there are many 
arguments for a random selection of cases. No sy.stem of 
evaluation and counseling can po.ssibly cover every individual 
case handled by the agency. Yet I have seen some systems 
in which every case had to be handled twice, first by a counselor 
and second by a higher official. A profcs.sional sy.stem of 
counseling is not possible if a case has to be handled twice in 
such a manner. The implication of such a system i.s that the 
counselors cannot be trusted, and somebody has to put on the 
stamp of approval for each case handled. 

Such a system of administration is based ujion the concept 
of restricted and limited responsibility, a concept which is 
not applicable to counseling. Yet many of our current pro- 
cedures in counseling are based upon a similar concept. But 
if we are dealing with professional people, we have to delegate 
to them lots of responsibility . Wc may have to spot-check cases 
for one of the three major objectives discussed above, but not 
for the reason of restricted and limited responsibility of the 
counselor. We have to keep in mind that there may be many 
levels of administrative responsibility, but there is only one 
level in professional counseling. 

Case reading is a term used in social work. We pull out a 
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folder iiiiti wc rciid it. Wc read it critically to see what was 
right and wrong in techniques used and to see what the coun- 
selor was trying to do; we make notes in the margin (unless 0111 
manual of procedures forhitls that!) or we dictate a criticism of 
procedures use<i; or we consult with the original counselor to 
see what he had in mind, hut failed to de.scril)e clearly in his 
case notes. We do not call him tin the carpet - we simply try 
to achieve an under.standing. That is the whole purpose of 
case reading. We simply want to say, "Tell me what you had 
in mind. It is not clear from this record." The language wc 
use is the language of profe.ssional equals, not the language of a 
superior officer even though the administrative responsibility 
is dearly present and defined. Or w'e may, instead of making 
notations in the margin of the I'ecord, have conferences in- 
formally, or use one of the other methods discinsscd below. 

Casff Conferences. I'lie third method of supervision is the 
case conferences, weekly or bi-weekly. An oral presentation 
of a case is made by a counselor. It may be a case selected at 
random; it may be a case brought in hy the registration officer; 
it may be the counselor's most perplexing case of the week or 
his best case of the year. As.suming that counselors have at 
least one “be.st" case each year, it is good .supervision to let him 
get the feeling of pride tliat comes with discussing with his as- 
sociates a case well ilonc. When the case conference is concluded 
he may not he .so proud of it, but he should have the sati.sfaction 
of .saying, "This is my be.s't case.” 'Die e.sscntial feature of 
this case conference is that people pool their ignorance publicly. 
They simply sit around a board as a group of professional 
equals and discuss and criticize each other’s professional work, 
always with the polite language of professionals, but being 
quite critical of others on the assumption that there is more 
than one technique to be learned because the same set of case 
data may be validly interpreted in at least two different ways by 
two different sets 0/ counselors. It is a very healthy thing for 
each counselor to hear other persons interpret the counselor’s 
own data. Of course, the presiding counselor must establish, 
and maintain impartially, “ground rules" for this scrimmag- 
ing, otherwise one individual will lecture his colleagues on 
what is “/Ae revealed truth I" 

We often rotate counselors in this presiding chair so that 
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every counself)r sits in the seal of honor from winch vantage 
point he discusses his own case ami gives hiw own umlcr.standing 
of the nature of counseling. This situation piohahly is one of 
the most effective techniques of all in supervision Iiecause in 
effect wc are permitting each counselor to be the evaluator and 
supervisor of every otlicr counselor, 'rherc is a certain ego 
status outcome of this experience that is very desirable because 
we do not lose status when professional equals cricici/.e equals 
as much as when tin administrative superior criticiy.es, even if 
he is one of the professional counselors. 

Evaluation by an "Outsider" . -The fourth method of evalua- 
tion involves non-regular inspections by visiting consultants 
who, after reading case records, may make an oral or written 
critique of each case read, or may partieij^ate in a case confer- 
ence and even make a written crititjuc alter tliey hear oral 
presentations by counselor.s. It is a good thing to bring in to 
the inner circle of counselors someone from the outside because 
one of the characteristics of human beings is that tliey settle 
down into a comfortable lut of piocedures very readily. We 
all like to regulan/e and habituate our lives, even our profes- 
sional lives. This characteristic sometimes is one of the most 
discouraging outcomes of dealing with human beings, even with 
professionals, because of the difficulty (if climbing tint of com- 
fortable ruts. People like habits .so much that they do not 
want to change and thus we hear some counselors say, “Weil, 
I’ve counseled this way nigh onto forty years; it’s been good 
enough so far and I don’t see why I should adopt these new 
fangled ideas, especially those non-ilircctivc techniques!” 
Whenever we hear counselors say such things, counseling is 
going rapidly downhill. To offset this tendency to settle into 
comfortable ruts we sometimes must prod people into progiess. 
This generalization is as much true of professional counselors as 
it is of politicians, school teachers, parents, even students, and 
certainly it is true of administrators! 

Viewing counselors as people with their own peculiar psychol- 
ogy, a most interesting phenomenon of the past decade is their 
psychological reactions to the prodding of the School of Re- 
flectors. Much heat and a little light have been generated in 
resistance to Rogers’ ideas, but his followers have prodded us 
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into thinking critically (if some things we have complacently 
taken for granted. We thought we had collected all of the 
carved tahlet.s from Mount Sinai but now we find that there 
arc a few we had overlooked. 

Yes, we learn much in conference.s with AusUmder even 
though the experience is often uncomfortable. When we say 
that we have counseled in a particular way for forty yearsj 
then that is the time vvhen an administrator ought to be the 
most worried. Incleai an administrator ought to worry most 
about his own tendency to regularize and rouiinize procedures 
Oftentimes he has the largest amount of resistance to new ideas. 
He smugly .say.s too often ; “We settled that jiroblem five years 
ago, Why do you reopen it?’’ Such a type of mental makeup 
in counselors and administrators and in mamial writers as well, 
is just holding back progress. The judicious use of the “visit* 
ing fireman’’ technique upsets such smugness and a good ad- 
ministrator always chuckles to himself whenever his staff is 
upset following a visit from .such an outsider. He thinks: 
“I have this stafT stirred up now. Maybe that experience will 
give tliem some new ideUvS.’’ Hut the counselors and the ad- 
ministrator himself will inevitably settle down again. There- 
fore a good administrator is one who knows when to prod him- 
self and others and when to rest before he prods them again. 
Of course he prods in ways wliich are not harmful to mental 
hygiene although some adm inis tra tons prod too much, I sup- 
pose, because they have an overactive thyroid or because they 
are building an empire too rapidly. On another occasion wc 
should explore the pensonnel problems of personnel adminis- 
trators. 


Criteria for Kvaluation 

What are the criteria for evaluation ? What is it we are look- 
ing for when we read a case as supervisors? We must have 
something in mind, some guideposts, some guiding principles by 
which we evaluate. What is the difference between two cases, 
between two counselors, etc? How do we differentiate between 
“good” and “bad” counseling? My experience yields six 
criteria but there may well be others more important growing 
out of the experiences of other counselors and administrators, 



3o6 educational and I’sYCHOLOfaCAI. ME VsURKMENT 

Conp'uence of Objectives. The congiTieiicc bet ween the ex- 
pressed desires of the client and the counselor’s advice is one 
of the simplest criteria. The coun.selee may say, "I have this 
objective or action in mind. I have come to see whether it is 
feasible ” What happened afterwards in the counseling situa- 
tion? The veteran came in with one mental set; he went out 
with another. What is the explanation for the change? If 
a counselor docs not reveal why there is a discrepancy, he may 
not be a good counselor. If he is not aware of the discrepan- 
cies, he has missed a significant point What is the explana- 
tion and is it a valid explanation^ It may he that tlie coun.selor 
has the case neatly ticketed with a particular vocational ob- 
jective in mind. But when the total case record is reviewed — 
background, schooling, de.sire to establisli a home today or at 
an early date, amount of supplementary rcsource.s, aptitude, 
etc. — the projected vocational objective is not feasible. There- 
fore, the counselor and the client searched for a .satisfactory 
substitute objective. That kind f>f an ex]ilanation of the 
putting together in a congruent and balanced “whole” of all 
the known pieces of relevant data is evidence of good counseling, 

Counselee Satisfactiou. Another bit of evidence of good 
counseling is the quality of the client’s transition from one 
stage of insight to another. When the counselee comes in 
with one mental attitude and leaves with another, the transi- 
tion usually has to be made without an emotion disruption. 
Otherwise we have a dissatisfied client, and dissatisfied clients 
are not usually the product of “good” counseling, although this 
bit of evidence, like all others, must always be interpreted in 
the context of the total case record. 

There are certain kinds of dissatisfaction that are inevitable, 
but we have to ameliorate a feeling of dissatisfaction, otherwise 
you have a client who says, "The counselor told me I had to 
do such and such.’' After all, this is a social democracy and 
clients should not be told that they have to do “such and such.” 

This criterion is very important - satisfaction of the client 
with the service and with the advice. Satisfied clients are a 
very important end in themselves, and there is a very real 
reason why they are Satisfied people often tend to think 
more clearly because they are not distracted by frustrations. 
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They tend to think moic clearly; they tend to exploit the pos- 
sibilities of the occupation if they feel it is one that is congenial 
to them emotionally. For this and other reason.s, evidences of 
dissatisfaction found in the case record must be explained by the 
counselor. 

I have made a side reference to the obvious fact that certain 
dissativsfactions arc inevitable and that some can be ameliorated 
but not prevented. That is true, lor example, of an individual 
who has made an irrational vocational choice a person with 
an IQ of 1 10 who wishes to he a dcjctor because of a fixation on 
the family physcian and is thus dof>mL'd to a certain kind of 
dissatisfaction. That is, it is inevitable because of the way our 
occupational world is organized. Such a type of dissatisfaction 
is not what 1 am talking about. Good counseling is possible 
whether or not the counselor could amelioiate such a type of 
dissatisfaction. But he docs not do it by saying, “You don’t 
have the right amount of IQ.’’ 'rhe counselor can handle that 
type of case eftcetivcly even if he does not convince the boy 
emotionally, as well as intellectually, that a substitute occupa- 
tion is a bcttei one for a person of his capabilities. 

You know well the techniques by which this result of coun- 
seling is accomplished. They arc not as much intellectual as 
emotional in character. Sometimes an emotional transference 
is the only way it can be done. The boy attaches himself 
emotionally to the counselor and will accept the counselor’s 
advice simply because he likes the counselor. Therefore rap- 
port is a very important technique in achieving some legitimate 
outcomes of counseling. It helps to gloss over disappoint- 
ment, merely because the counselor has a sympathetic insight 
and shows it in the way he treats the client Appreciation of 
and insight into emotional subtleties are important in counsel- 
ing. These ai e often the signs of “good" counseling the super- 
visor is looking for as he reads the typed and written record. 

CounseUe Understanding, -Indications of the adequacy of 
understanding by the client of the information and especially 
of “advice" given by the counselor are important, One of the 
most difficult puzzles a counselor must solve is to get the client 
to see what it is he is being advised to do. The distortions 
of understanding by the client are often as ingenious as those 
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recorded by students in class examinations. The inability of 
people to hear accurately is an alarminp thins: Ihive you ec^er 
heard a client rcpioduce the advice yf)u pave him ? 1 r does not 

sound like what you thnupht you litul said originally. These 
distortions are not intellectual in their otipin there are all 
sorts of psychological factors involved But it is not only 
understanding of advice bur, more impoitant, the l)a.sis for 
that advice that is involved in good counseling. In a social 
democracy one of the end goals is to help people to learn to 
stand on their own feet in regulating their lives. 'Fhat is why 
counseling is so basic in our culture. If that goal is to be 
achieved, then the client must learn the hasi.s of advice given 
to him and this means that he must learn methods of solving 
personal adjustment problems. Hence the supervisor of coun- 
seling reads the record for evidences of effective tcacliing of 
methodology — not merely for an effective solution of the client’s 
current adjustment problems. 

Last year when I was in Germany I ohscrveil a different type 
of counseling. I found an “assignment" counseling. One 
vocational counselor argued that in (lermany the counselor 
never insisted that an individual hud to follow an occupational 
choice, and yet at the same time tlie counselor reported that the 
parent had the final word on what occupations should be 
chosen by a son or daughter. 1 asked, "Does that mean the 
parent dictates?’’ The reply was a return to the statement 
that the student -was free to choose a curious contradiction 
without insight. But during the Nazi regime a person had no 
freedom of vocational choice. That is, unless he "cliose” the 
occupation the “state” thought most necessary for the state. 
That is a widespread concept on the continent, that the state 
does the choosing in subtile or indirect Avay.s, Such a concept 
has a familiar ring because counselots in military establishments 
“assigned” persons to particular jobs and e.stablishments. But 
this method is not what wc u.sc if we desire people to learn to 
solve their problems, 

In effect wc are trying to help our coimselces to be their own 
counselors. This need not alarm the administrator that he will 
run himself out of business. Rather, the more intelligent 
people get about counseling, the more they come to experts. 
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Most persons will he umuteurs in counseling themselves. Even 
the experts, when it conies to their own problems, are amateurs. 
If you are a counselor and have children, you know you arc 
often tlisqualificd and unqualified to counsel your own children 
and you mu.st “borrow” services from another expert. Tlicre 
is something about the nature of counseling relationships tliat 
make thi.s situation almost inevitalile. 

Increased self-understanding as a preparation for later read- 
justment- -I wish I liad more time to give to it because it is 
the most important outcome of counseling, the one least under- 
stood, and the one on whicli wc have the fewest established 
facts and techniques. How do you teach people self-under- 
standing? It is a very difficult problem, and just “telling” 
people what you advise and why you atlvise it is not often an 
effective device I'here has been enough experimentation to 
indicate that just “telling” our client why we advise something, 
does not necessarily give him deep undet standing. But the 
case reader searches for bits of evidence of the counselor’s 
attempts to teach self-understanding and methodology of 
achieving self-umlerstanding. 

Occupational Opportunities . — Congruity between vocational 
advice and the training opportunities available, or those which 
could be made available, is significant. I remember a case 
that illustrates this importance in an unusual manner. It 
happened about 19J2 during the depression. A girl came to 
me for advice, and said she wanted to go into teaching, We 
collected case data and intelligence tests and found everything 
was quite favorable, so I advised her to go altead. You will 
remember the surplus of teachers in those days. I was telling 
a visitor about this case and she said, “I hope you didn’t en- 
courage her to go on. There are thousands of teachers who 
cannot get a job today, and you should not encourage a student 
to go into teaching. How do you justify your advice?” I 
replied: “I explain it by the fact that this was an unusual 
individual. There are some teachers being hired, and I assume 
that a well-qualified person is not going to have a hard time 
getting a job, even in this depression period. There is always 
some occupational mobility, a few persons are being hired even 
today. Secondly, this individual is beginning her professional 
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training, and can you pi edict what employiueiu conditions are 
going to he. four or five years hence? Tliesc two reasons justify 
a little caution in using present day iahor market conditions 
as the sole basis of vocational guiiianrc of cnWcuv freshnmt." 

All this is hy way of warning counselors to he aware of the 
broad context of counseling data. I’hcy should not tie voca- 
tional guidance too closely to imincdiale employment oppor- 
tunities, Training usually takes a little rime, and employment 
opportunities have a way of fiuctuutimt. I know of no basis 
on which we can predict, with a great tleal ol certainty, next 
year’s employment opportunities, and cci rainly today’s employ- 
ment opportunities are not necessarily going to he representa- 
tive of those available three or four years from now. Caution 
should be exercised in interpreting employment opportunities 
in vocational advisement. And the case reailer searches for 
indications drat both the counselor and the counselec under- 
stand such types of cautions and safeguards in interpreting 
and using case data. 

Personality Perceptions.- The fifth criterion is ihc adequacy 
of consideration given hy the counselor to personality factors. 
Some counselors .seem to feel that if the individual has basic 
aptitude, that is all that is necessary for "succc.ss.” They seem 
to have forgotten that most occupations are jtoew/ occupations 
demanding basic skills in working with other jieoplc, that .social 
adjustment in itself requires basic aptitudes. We, therefore, 
have to give careful consideration to the personality makeup 
of the individual, even in vocational ^nidauce. Contrary to 
popular thought, mental hygiene is not restricted to explosive 
emotional troubles, rather is it a normal part of this particular 
kind of civilization we have today, 'riierefore, personality 
counseling is a very important generic technique, and the 
the counseling supervisor is alert to the counselor's perceptions 
of this phase of the counselec’s adjustments. 

Adequacy oj Records, -The sixth and last criterion is a very 
routine, mundane thing, and yet it is a rather iiniiortant mark 
of a good counselor - the adequacy of notes and records. I 
am a believer in making standard interview forms and then 
throwing them away and giving the counselor a blank sheet 
of paper on which to record what he wishes to have recorded 
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in the history, I know of no way so to standardize counseling 
that you can embalm its substance all in a narrow box on a 
printed form. In sharp contrast, the free-flowing type of 
record-keeping gives the counselor elbow room to express what 
he seems to think is important about a particular case. Rigid 
procedures and tight fitting forms grow from attempts to 
standardize counselor and counseling. And I am persuaded 
that neither can, or should, be fully standardized or even fully 
structured. Kvery professional service encompasses some ele- 
ments of imaginative inventions and counseling is no exception. 

Anyone who re-reads another’s case notes must be able to 
reconstruct the entire case situation, and we cannot do that 
from a form. We can better approximate a full understanding 
of counseling processes from a free running account or descrip- 
tion, There is some indication that a fully dictated account is 
more adequate in the sense of being a more valid report of what 
actually transpired than is a brief summary of the outcome 
of the counseling. However that may be, we cannot evaluate 
counseling until we can reconstruct the processes that lead up 
to the outcomes. If we desire the outcomes of counseling to 
be recorded in a nc:it form with a few phrases, and if I review 
and evaluate and supervise, then I w'ant to be able to recon- 
struct the processes by which the counselor thought he and the 
client arrived at that end product. If we merely evaluate in 
terms of end product, we cannot evaluate counseling ade- 
quately. In order to understand it is necessary to have more 
complete notes than aie usually afforded by standard forms. 

I have discussed briefly three objectives of supervision in 
the field 0/ counseling from the viewpoint of an administrator 
charged with responsibility for maintenance of an effective 
personnel program for clients. Four methods of achieving 
these objectives were outlined from the viewpoint of a super- 
visor of counseling in a public agency devoted to a program of 
personal services to clients. Finally, six criteria were described 
in terms of their contribution to an evaluation of the effective- 
ness of counseling services. 
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A RECENT article in this journal by Louis Guttman (6) il- 
lustrates several of the difficulties with scale analysis at its 
present stage of development. One of these difficulties con- 
cerns the location of cutting points for various items. With 
perfect reproducibility there would be, of course, no problem, 
The cutting points for an item would simply be the dividing 
points in the rank-order scores where the response shifts from 
the more to the less favorable category. Items are perfectly 
reproducible when from rank-order scores we can reproduce 
all the responses to the individual items. All subjects with 
rank-order scores above the cutting point would respond by 
checking the more favorable alternative and all those below 
would respond by checking the less favorable alternative. 
There would be, in the case of perfect reproducibility, no over- 
lap in the responses of the subjects below and above the cutting 
point. But perfect reproducibility is an ideal case and is not 
likely to be encountered in practice. The question thus arises 
as to liow the location of cutting points for items which are 
not perfectly reproducible Is to be determined. 

Guttman offers the suggestion that the cutting point should 
be located so as to minimize error (6, p. 258). But since it is 
also true that the reproducibility of an item can never be less 
than the frequency in the modal category, we have another 
rule that “no category should have more error in it than non- 
error” (6, p. 261). Now these might seem to be obvious and 
easy rules to follow, but apparently Clark and Kreldt (i) 
experienced some difficulty in agreeing in the treatment of 
items when working independently according to the rules. In 
terms of the data presented in Guttman’s latest article (6), it 
would seem that there is some inconsistency there also. 

I would like to express my indebtedness to my colleague, Professor Paul Horst, for 
the many discussions we have had concerning scale theory, and for a critical reading 
of this paper, 
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Guttman finds a ajcfficicnt of rcproducibihry of 89 per cent 
for the 7-item test concerning attitude toward J NaUo 7 i of 
Nations (6, Table 3, p, 159) and this area is considered scalable, '■= 
All of these questions meet the rule concerning Ic.ss-error than 
non-error in the categories. However, for the 7 items, all 
dichotomous scoring, concerning attitude towartl Black Me- 
tropolis (6, Table 7, p. 275), Guttm.in arrives at a different 
conclusion. "Several of the questions have more error than 
non-error," he states (6, p. 172). The content of this area is 
therefore judged non-scalable. 

If the reader will re-examine Guttman'.s Tabic 7, however, 
it can be demonstrated that Guttman's conclusion does not 
necessarily follow. The cutting points can be placed so that 
no category has more error than non-oror and the coefiicient of 
reproducibility will be found to be HH.3 per cent. 'Phe cutting 
points which yield this coefficient can mo.st easily be given, for 
the reader who wishes them, by giving the dividing points in 
the frequencies at the left of Guttman's 'I'able 7 for the various 
items. Thus, for the first item, the cutting point f.dls between 
the 9th and loth individuals, counting from the hot lorn up, 
The location of the cutting points for the othei items are as 
follows: (Item 2) between the mb anil I2fh individuals; 
(Item 3) between the 13th and Tqth individuals: fitetn 4) be- 
tween the i6th and 17th individuals; (hem 5) between the 5th 
and 6th individuals; (Item 6) between the 19th and 20th 
individuals; (Item 7) between the 7th and Hth individuals. 

If the cutting points given above are used, no item will have 
more error than non-error, if error is interjircted as Ciuttman 
apparently does with respect to the 7 items concerning A 
Nation of Nations which gave a coefficient of reproducibility 
of 89 per cent. Furthermore, we have here only 41 errors 
compared to the 40 errors which Guttman counted for the 
A Nation of Nations test. Why, then, is one area judged 
scalable and the other not?* 

’ There are other eriierui for sc.ilttltility ns outlined bv Ciminiiui in varinii*, piiLilicn- 
lions (4, j). Wc are not here concerned with sc.ilahility .i-, -.ut'h, but only with the 
computation and interpretation of the coelTiiicnt of rtproducibiluy. 

“Thar other criteria are to he applied in judpinit sc.ilahility it.is Iwen iioinred out 
before, Guttman, however, does not mention these us ihe h.ois for his rejection of 
the hypothesis of scalability of the items under consider.uion. The only reason given 
IS that "too much error" is .still present (6, p, 274) 
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The results of tlic analysis cited, however, are definitely mis- 
leading. And this statement applies equally well to Guttman’s 
analysis of the A Nation oj Nations test. The reason is that 
some of the cutting points used in counting errors fall within 
a given score interval. If cutting points are to be rigidly de- 
fined, then they must fall between scores. Only in this way 
will the coefficient of reproducibility have meaning. It is 
Guttman’s contention, for example, that the coefficient of re- 
producibility measures the degree to which it is possible to 
reproduce item responses from rank-order scores. This is 
true, if the coefficient of reproducibility is computed In the 
manner to be described, where cutting points fall between 
scores. It is not true if the coefficient is computed as Guttman 
does for his Table 3. For the data given there, Guttman be- 
lieves that it is possible to reproduce from a person’s rank-order 
score his response to each question with 40 errors for the entire 
sample (6, p. 260). Let us examine this claim in some detail. 

Tabulating the most frequent patterns of response from 
Guttman’s Table 3, indicating the weights and the frequencies 
of each score, we arrive at our Table i. 

Now if we predicted the response patterns shown for the 
scores at the left of Table i, we would make the errors given 
at the right of the table. Thus 40 of the responses, for the 
sample at hand, would be incorrectly predicted. But there is 
an obvious difficulty with some of these patterns: those marked 
with an X are inconsistent with the notion of a scale, For we 
have, for each of the patterns marked with an X, subjects 
with lower rank-order scores giving more favofiable responses 
to items than subjects with higher rank-order scores, or sub- 
jects with higher rank-order scores giving less favorable re- 
sponses to items than subjects with lower rank-order scores. 

The logical procedure, and one consistent with scale theory, 
would seem to indicate scoring the individuals with "incon- 
sistent” patterns as the nearest "scale type” (4). That is, if 
we make the patterns for these scores consistent with the rest 
of the data and with the notion of a scale, we would have the 
response patterns given in Table 2. We see that scores 10, 
8, and 7 would now be scored with scale type 9; score 5 would 
be scored as scale type 4; and score 1 would be scored as scale 
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type 0, The pattern for score \z must also be revised. Es- 
sentially, what we liave done is to treat the .set of items at hand 
as if they were perfectly reproducible for the sample. If this 
weie true, then the scores lo, S, 7, 5. and 1 would not appear in 
the sample, nor would the patterns of response giving rise to 
these scores; the response pattern for .score 12 would also be 
revised as indicated. 
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If the statements above are true in the case of perfect re- 
producibility, and if we now compute the coefficient of re- 
producibility based upon dcviation.s from the patterns that 
would appear in the case of perfect reproducibility, we have a 
legitimate measure of the degree to which resjionses to the 
items can be reproduced from rank- order scares This is an 
objective and reliable definition of the coefficient of reproduci- 
bility. Our predictions of item responses are based upon the 
assumption of a perfect scale or perfect reproducibility for the 
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sample at hand; the coefficient will indicate the degree to which 
we approach icxd per cent reproducibility. 

We shall have the same number of eirors for all scores except 
the ones for which the response patterns have been changed to 
accord with the notion of a scale. The errors we oiiginally had, 
40, have now been increased by 9. This gives us a total of 
49 errors or an increase of aci.5 per cent over the original 40 
counted by Guttman. The coefficient of reproducibility is 
changed relatively little, of course, by this increase in this 
particular instance. It is now 86 per cent compared to Gutt- 
man’s original 89 per cent. With a larger number of cases and 
additional items, the difference might be quite significant. 

There is still another point to be mentioned concerning the 
reproducibility coefficient for a given set of data. For the 
sample at hand, Guttman’s Table 3, it is obvious that subjects 
with scores of I4 and o cannot possibly contribute any error. 
There is one and only one way in which these scores can be 
obtained and the response pattern for subjects with either of 
these scores will be perfectly reproducible regardless of any 
other factors. In the present sample there are 6 such cases 
contributing a total of 6x7 or 4a responses out of the entire 
sample of 350 upon which the coefficient of reproducibility is 
based. Obviously, with an excess of cases at either extreme 
or both extremes of the scale, reproducibility might seem much 
better than it actually is. For example, if we eliminate these 
cases, and use only the data which permit error, we have only 
84 per cent reproducibility. 

The criticisms raised here arc not directed at the theory of 
scale analysis, Guttman has made a signal contribution to 
test construction — a contribution that is not to be disparaged 
There is, however, a definite need, at the present time, for a 
clarification of the problem of locating cutting points and com- 
puting coefficients of reproducibility, so that the technique has 
a higher degree of objectivity in the hands of various investiga- 
tors. The suggestion offered here is that we, for a given sample, 
assume perfect reproducibility, and make our predictions of 
Item responses on this assumption. Error may then be meas- 
ured in terms of the number of responses departing from the 
pattern predicted. Cutting points for items would thus be 
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rigorously defined and would ahvay.s octur iictwccn ranks. 
Scores which are inconsistent with the assumjnion of perfect 
reproducibility would l)e scored as the nearest scale type con- 
sistent with the notion of a scale. This method .should lead 
to essentially the same results when u.sed by various investiga- 
tors and has been advocated by Goodenough (3), 

The difficulties mentioned above are relatively minor ones. 
The major problem, which Guttnuin has not as yet .solved, is 
the original selection of the set of itcm.s to be tc.sted for .scala- 
bility. Techniques of item analysis, in the .semse in which this 
term is ordinarily used by test constructors, are apparently ig- 
nored by Guttman in favor of an a priori selection of items by 
the investigator. Out of the hundreds of items which could 
be written concerning any defined area of content, Guttman 
selects but lo to n to test, as a set, for scalability. Why one 
particular set is selected rather than another remains something 
of a mystery, if we may take the sets presented in various 
papers as representative of the a priori approach advocated. 
To say that we should look for items that .seem tt) he homogene- 
ous in content (5, p. 461) adds relatively little to what many 
test constructor.s have known for some time. 

Scale analysis, it may be said, permits us to evaluate how 
well we have selected a set of items with rc.spect to homogeneity 
after they have been selected. It doc.s not tell u.s how to .select 
items which will be homogeneous. 
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THE EVALUATION OF PAIRS OF TESTS FOR 
GUIDANCE USE 


GEORGE K. BENNE'rr and JEROME E. DOPPELT 
The Psychological Corporation 

In the process of educational or vocational guidance, it is 
the usual practice to employ several tests which are adminis- 
tered to the client for the purpose of revealing his strengths 
and weaknesses so that he may decide upon a career which will 
utilize his superior capacities and avoid, so far as possible, de- 
pendence upon those characteristics in which he is least able. 
Consequently, it is desirable to have tests which do not cor- 
relate veiy highly with each other, thereby measuring rela- 
tively independent traits. Another characteristic of importance 
in the selection of tests for this purpose is high reliability so 
that differences in scores shall be, so far as possible, true dif- 
ferences rather than accidental ones. 

Whenever two tests are considered for use in combination, 
it is convenient to have some means of determining their dif- 
ferential power. Some investigatois have used the corrected 
coefficient of intercorrclation or a function of the coefficient 
of correlation, the coefficient of alienation (k), as a means of 
estimating the degree of independence of a pair of tests. 
Neither of these statistics lends itself readily to meaningful 
interpretation in terms of differential power. Some years ago 
T L. Kelley^ proposed another method which he called “the 
proportion of differences in excess of the chance proportion.” 
This method also depends upon the reliability of the tests and 
their intercorrelation. It has the advantage, however, of 
being directly meaningful since it estimates the proportion of 
all differences for that pair of tests which will represent true 
differences in ability. 

‘ Kelley, T. L. "A New Method for Determining the Significance of Differences in 
Intelligence and Achievement Test Scores." 'Journal oj Eaucatkna] Psychology, XIV 
(1923), 3ai-333. 
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Although the method for computing this statistic was de- 
scribed so long ago, instances of its application are very rare. 
David Segel scem.s to have been the only experimenter to 
publish a report of its use.’ 



Fio. I Graphic illustration of the “proportion of ilirtcrriitrs in rxcc-.s of the chance 
proiTortion ’’ “A" and ''li" arc normal ciirvci of unit nrc.i wiili trn uita ■ Curve 
A represents the distribution of differences rctulting solely fnun the unreliability of 
the tests. Curve H represents the distribution of obtained dilTercnccs. Tlic shaded 
areas under curve 13 represent the prtiporiion of diircrcnces in excess of chance. For 
example, this condition would result from two tests with rcsjwctivc reliabilities of 8o 
and .90 (mean Ui »> ,85) where the intercorrelation is .40. The poiixirtion of differ- 
ences in excess of chance is 

FORMUI-AS. Standard deviation of differences due to unreliability of tests 
(Curve "A" above) 

ffj.au a s/i — m — rju 

Standard deviation of obtained distribution of differences (Curve “B" above) 

vd “ "s/a — aris 

Further discussion of differences pertaining to individuals may be found in Kellev, 
T, L. Fundamentah of Statistics Harvard Univ Press, 1947, pp. 4tJ~4i9 

Figure I will aid in understanding the Kelley method. Two 
tests are administered to each member of a group. The scores 
are converted to standard scores and the difference is obtained 
for each individual. The distribution of such differences is 
represented by Curve “B” in Figure I, It is evident that the 
width of this distribution is inversely related to the intercorrela- 

® Segel, David. Differential Diagnosis. Baltimore: Warwick and York, 1934. 
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tion of the tests. However, since the tests lue not perfectly 
leliable, some differences will result solely from errors of meas- 
urement This hypothetical distribution of diffeiences re- 
sulting from the unreliability of the tests is shown by Curve 
“A” in the same figure. The area under Curve "B” and out- 
side Curve "A” represents the “proportion of differences in 
excess of the chance proportion.” 

To compute this index, it i.s necessary to find the values for 
the two standard deviations, the ratio of the distribution of 
errors to the total distribution, and finally, to consult a table 
prepared by Kelley which gives the area unique to Curve “B” 
for selected values of this ratio. 

In connection with the development of a series of differential 
aptitude tests, there was frequent occasion to perform this 
computation and, as a labor-saving device, the nomograph 
appearing in Figure II was prepared. Values determined 
from the nomograph correspond almost exactly with those ob- 
tained from the Kelley tabic. (A mathematical method for 
obtaining the “proportion of differences” is explained at the 
end of the article.) 

It should be emphasized that the reliability and intercorrela- 
tion coefficients used must be both realistic and appropriate to 
the group with wliich the tests are to be used. Tlic spuriously 
high reliability coefficients resulting from the use of split-half or 
Kuder-Richardson formulae with speeded tests will give over- 
estimates of tlie proportion of differences. Coefficients ob- 
tained from groups of greater or lesser homogeneity will yield 
distortions. Very often the coefficients given in test manuals 
do not satisfy these requirements, apparently having been 
selected more for promotional value than foi authenticity. 

Kelley, in his original article, applied the method to data from 
the first edition of the Stanford Achievement T est. Segel has 
used this method with the three parts of the Gates Primary 
Reading Pests and with the four parts of the Gates Silent Read- 
ing Pests. The average proportion of differences for these 
tests is not far from .25, which value is regarded by Segel as 
about the minimum degree of differentiation required for 
useful diagnostic tests. 

The Kelley method was recently applied to two fairly well- 
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known batteries for which sufficient data are available. The 
Detroit General Aptitudes Examination produces three subscores 
entitled “Intelligence,” “Mechanical,” and "Clerical.” The 
intercorrelation.s are all higher than .7 and the reliabilities, 
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above .8. The proportions of differences arc .06, .07, and .21, 
none meeting Segel’s requiremenr. 'I'he second test battery 
is the Engineering^ and Physical Science Aptitude */«/, edited 
^ There are six sections in thi.s instrument with 
reliabilities ranging from .68 to .93. The 15 intercorrelations 
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range between .28 and .61. The Kelley index values are from 
,14 to .42 with six exceeding .25. 

More extensive use of the method has been made by Bennett, 
Seashore, and Wesman in connection with the Differential 
Aptitude Tests.^ This senes of eight tests was, from its incep- 
tion, designed to produce a profile of scores useful in the guid- 
ance of high-school students. It was apparent that the battery 
must have good differential power to justify its use m the man- 
ner intended and the Kelley method proved of help throughout. 
The first step in this development was to study available test 
data to see which pairs of meaningful measures could ef- 
fectively be used at the same time. Since the practical upper 
limit of reliability for short power tests is about .9, it was 
decided that the maximum permissible intercorrelation would 
be about .6 with lower values desirable. This approach clearly 
indicated that certain combinations of variables, such as arith- 
metic reasoning and arithmetic problems or synonyms and 
verbal analogies could not be expected to contribute impor- 
tantly to the diagnosis of ability. On the other hand, it was 
somewhat surprising to find that spelling and grammar, which 
were originally considered as subsections of ‘‘language usage,” 
were sufficiently independent to warrant individual considera- 
tion. 

Having selected a promising set of tentative variables, the 
next step was to find item forms suitable to the ability levels 
intended, namely, grades 8 through 12, and producing the 
maximum reliability per unit of time. It is not feasible to 
discuss here the various item types tried, but the test authors 
were successful in producing a series of eight tests, none over 
thirty minutes in length with reliabilities ranging between .85 
and .93 for a single grade of high-school boys and, with the 
exception of the Mechanical Reasoning ‘Test, between .86 and 
.92 for a single grade of high-school girls. The intercorrcla- 
tions fall between .06 and .62 for boys, and between .12 and 
.67 for girls. The respective mean intercorrelations are .38 
and .gp.'' 

^ Diffeieniiiil Aptiliidt Tests (Manu.il and eight test'.). New York. The Psycho- 
logical Corpor.ition, 1947. 

‘The.se data are taken from Section C of the Manual for the Diferenttal Aptittide 
Tests 
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The application of the Kelley method to these data yields 
quite satisfactory results. The proportions of differences in 
excess of the chance proportion arc as follow.s: 

For boys, from .29 to .52 with a mean of .39. 

For girls, from .ao to .48 with a mean of .34. Four value.s are 
lower than .25 and these all involve the mechanical reasoning 
test which has unsatisfactory reliability when administered 
to women. 

In conclusion, the authors should like to .say that their ex- 
perience with the Kelley method leads them to recommend it 
highly both as a means of evaluating exi.sting test combinations 
and as an aid in the construction of new test batteries 


Mathematical Note on Computing the "Proportion of 
Differences” 

Consider the two noimal euive.s shown in iMgure 1 . 
The equations of the two curves may he written as’ 


.Vl 


N 

- - e 




aiul 





Since the curve.s are of unit area .V i 
Let = k and let cr, ~ i 
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The equations of the curves may then he rewriiten as' 


■vi 


k\/ 2 r ‘ 




and 




I 

f 

V iJT 


( 1 ’ 9 /S' 


To find the abscissa values of the point.s of intersection of 
the two curves; 


- - c ' .j, Wat .. 

k-y 2ir V CLv 

Take logarithms of both .sides (common log.s have been used 
in this development) : 
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= log k 


a __ log k 

log e{k- - i) 

O' 1 I log k 

Smcelog,o^= .43+3 -v - _■ j) 


X, the abscissa values of tlie points of intersection of the two 
curves, is given by: 




/ 2k- log k _ 

.^M3ik- - I) 


k, the ratio of vi and <ra, may he determined by applying the 
formulas shown under Figure I. The value of -v may then be 
found by using the above formula. The areas under the normal 

X 

curve for abscissa values of a* and - may be found from a table 

of area under the normal curve. The difference between the 
two areas multiplied by a is the “proportion of differences in 
excess of chance.” 




A STUDY OF CLIENT SELF-SELECTION OF TESTS IN 
VOCATIONAL COUNSELING 


JLII.IUS SKKMAN 
University of Chicago 

It is a basic postulate of psychology that organisms react , 
selectively to their environment. Stated more inclusively, the 
principle holds that within limits of structure and capacity, or- 
ganisms tend to select fiom their milieu those elements which 
preserve their existence, foster their development, and maintain 
their integrity as separate living entities. Professional workers 
have been concerned with the application of this principle in 
diverse areas of human experience and have dealt witli it at 
varying levels of discussion and demonstration. 

Davis (3) has refiortcd a long-term study designed to test the 
adequacy of .self-selection of diets by infants. In this study, 
conducted with babies at the time of weaning, a representative 
assortment of widely used common foods was presented to the 
children in separate dishes )>laced on a tray. Each child was 
allowed to eat whatever foods he wanted in whatever order and 
quantity he desired, Davis concluded that the children not 
only ate adequate diets and grew in normal fashion, but that 
there was a marked absence of anorexia, behavior problems 
connected with eating, or need for cathartics at any time during 
the experiment. 

The use of the self-selection principle has been reported in 
two descriptive studies, by Olson (6) with reference to nursery- 
school sleeping schedules and by Olson and Davis (7) in con- 
nection with development of reading ability and interest. In 
the nursery-school study, Olson described an expeiience at the 
University of Michigan Elementary School in which it was de- 
cided to follow the full implications of the self-selection prin- 
ciple and not require afternoon naps of all children, as had 
theretofore been done. The report stated that 

3^7 
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The ii priori arguments regauling the social effects of the 
example of non-nappers on those who .still napped proved 
unfounded; some children napped reguhuly, otliei.s only 
when exceptionally tired Teacher;, testily to tlie increased 
.seienity of the childien ( 6 , p. 54) 

The reading study was designed to observe the reading 
growth of children in a permissive environment in wliich each 
child could set his own limits with respect to the number and 
kind of books to be read. A wide variety of books was placed 
in the classroom; the teacher made no assignments to the chil- 
dren, acting only as the children needed and desired reading 
assistance. At the close of the term, evaluation disclosed wide 
variation botli in the number of books read and the reading 
ability of the children. The authors sorted out the correlative 
factors of the differential growth lates— mental age, physical 
attributes of the children, and social and emotional maturity' — 
and concluded that “When an environment is supplied which is 
stimulating, the child reacts to it in terms of his total potentiali- 
ties for growth” (7, p. 78). 

Kurt Goldstein, thiough extensive work with brain-injured 
men, formulated the principle thus: 

Normal behavior corresponds to a continual change of tension, 
of such a kind that over and over again that state of tension is 
reached which enables and impels the organism to actualize 
itself in further activtlies, according to its nature 
Thus, experience.s with patients teach us tliat we have to 
assume only one drive, the drive of self-actualization . . . (j, italics 
in the original). 

In the field of personal adjustment, Rogers has stated a phi- 
losophy of counseling which makes much use of the self-selection 
principle. In a statement of the underlying assumptions of 
this method he said • 

We have known foi centuries that cathar.sis and emotional 
release were helpful . . . But we have not known or recognised 
that in most if not all individuals there exist growth forces', 
tendencies toward self-actualization, which may act a.s the 
sole motivation for therapy. . . . The individual has the 
capacity and the strength to devise, iiuite unguided, tire steps 
which will lead him to a more mature ami more comfortable 
relation to his reality (9). 



SELF-SELECTION OF TESTS IN COUNSELING 


329 


It is the purpose of the present study to illustrate the applica- 
tion of the principle of self-selection to another area of expe- 
rience. The study takes as its base an exploratory report by 
Bordin and Bixler, describing a method of test selection in voca- 
tional counseling in which the client is given the responsibility 
for selecting the kinds of tests he wishes to take (2). In this 
procedure the counselor describes to the client in non-technical 
language the tests which the agency has available and the in- 
formation whicli the client may secure from each test. The 
client himself chooses the types of information he wishes to 
secure The counselor makes the technical choice of the test 
■which will best yield the desired information but does not add 
other tests or otherwise modify the client’s choices. The 
method which these authors describe is based upon two prem- 
ises; first, that clients who come for vocational counseling 
may be in need not only of information which tests can supply, 
but also of personal reorientation with respect to their attitudes, 
feelings, and motivations; second, that 

. . . clients can deal most effectively with their own feeling.s 
and attitudes when they are active participants in the interview 
process, when they aie peumtted to attack their problems on 
their own terms, and when they arc permitted to choose tlieir 
own directions in grappling witli their own problems (1, p. 362). 

Before proceeding with an examination of some results of this 
method of test selection, it may be well to carry a step further 
the theoietical basis on which its use is predicated. It is not a 
novel conception that clients who come to counselors because 
they have vocational problems have at the same time a whole 
complex of drives, attitudes, and motivations — that they are, in 
short, unitary reacting organisms whose vocational problems and 
personality organization are part of a single system of behavior. 
Although this principle has received a good deal of clinical ac- 
ceptance, it has as yet been the subject of little experimental 
treatment.^ Agencies have published classifications and fre- 
quencies of problems bearing the rubrics “educational prob- 
lem,” “vocational problem,” “personal problem,” or combina- 

^ Recent contributions by Hordin ( 1 ) and by Pepiasky (8) have dealt with problems 
of psycholopicnl diagnosis in student counseling 
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tions such as “vocational-emotional problem.” The latter 
classification, though descriptive and serviceable, takes into 
account only that truncated range of behavior where maladjust- 
ment in in evidence But in accordance with the “unitary re- 
acting organism" theory, it is postulated here that interaction 
between vocational problems and total personality adjustment 
exists in some form at all levels of personal organization. A 
working hypothesis which takes such interaction into account 
through the whole range of behavior is that the manner in which 
an individual meets his vocational problem is ajunctwji of hts total 
prevailing level of adjustment Thus, it is suggested that a 
stable, well-adjusted individual will by and large solve his voca- 
tional problem in a mannei more direct and less neurotic than 
an individual who has typically met situations neurotically. 
Conversely, an individual who has long been insecure and fear- 
ful, who has denied his problems, or who has developed malad- 
justive mechanisms may be expected to retted these tendencies 
in dealing with his vocational problem. Since a counselor’s 
work brings him into contact with clients of many levels of 
adjustment, he must be aware of and make provision for the 
personal-adjustment concomitants of vocational indecision. 
The method of client self-selection of tests is employed on the 
basis that it provides the possibility of a growth experience for 
the individual with basic adjustment problems as well as for 
the stable, well-adjusted individual. 

The use of this method of test selection raises a number of 
questions which may best be answeied by research evidence. 
The present report will concern itself mainly with two of these 
questions. The first deals with the kinds of test choices the 
clients make. Counselors often spend considerable time train- 
ing in the use of tests; is it to be expected that clients can make 
appropriate choices without prior training and within the span 
of one interview ? 

The second question, a more general and exploratory one, 
concerns the interview behavior dis]ilayed by clients during the 
test-selection process. How do the clients react to the test 
selection process and what kinds of u.se do they make of the 
interview during the course of this process? 
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The Experimental Client Sample 

The data to be reported were derived from the initial coun- 
seling contacts of fifty clients who came to the University of 
Minnesota’s Student Counseling Bureau for vocational coun- 
seling between December i, 1946, and March 30, 1947. The 
clients were interviewed by either of two counselors’* who used 
the test-selection method here described. Six of these inter- 
views for each counselor were electrically recorded. The cri- 
terion of eligibility for admission of data into the experimental 
sample consisted of the requirement that the client be one who 
came voluntarily to the Bureau for vocational counseling. 
This eliminated clients who were referred primarily for adminis- 

TABLE 1 


Tens nj /{nmogeiitily of Expenmtnlal and Control Groups 


Variable 

X«orI. 

ilf 

Repull 

I. Number ofreasons for coming 

X’, 4.632 

10 

Not significant 

to Bureau 




2 Types of reason, s for coining 

X», 0 610 

15 

Not .significant 

to Bureau 




3. Veteran or non-vctcr.in 

X’, 8.385 

5 

Not significant 

4 Year in school 

X*, fi or/> 

10 

Not significant 

!, College 

X‘, 3.221 

5 

Not .significant 

6. High school rank 

V, 4.225 

J27; 5 

Not significant 

7 Amcr. Council Test 

1 '*, I.6I0 

Si IS 9 

Not .significant 

8. Age 

D .I-.I.T! 

5; 164 

Significant at 1% 


trative purposes; it did not eliminate clients who may have had 
other types of adjustment problems, so long as their presenting 
problem included a vocational problem. The sample consisted 
of fifty consecutive clients who met the criterion for admission. 

In order to determine whether this sample was representative 
of the general Bureau clientele, the experimental sample was 
compared with a control sample of 120 clients who were inter- 
viewed by four counselors.’* In each instance, the hypothesis 
under test was that the clients of all six counselors were drawn 
from the same population with respect to the variable tested. 
The following table indicates the variables on which the samples 

’The writer wishc.s to expre.ss npprcdntion to Mrs. Vita K. Birnberg, Mr Charles 
W. Gouldinfi, Miss Phyllis Morris, tind Mr. II. Wilkes Wright of Minnesotn’s Student 
Counseling Bureau and to Mr. Ray H. Bixler of the Minnesota P.sychiatric Institute 
for their cooperation m the .study. 
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were compared and rhe results of the test of the null hypothesis. 
The X’ test was used for enurnerative ilata and the analysis of 
variance for continuous data. For the analy.ses of variance, 
the use of the Welch-Nayer te.st revealed that the assumption 
of homogeneit)' of variance required for the use of analysis of 
variance was satisfied in all cases. 

Variables i and 2 represent results of a questionnaire filled 
out by clients just prior to the interview and designed to obtain 
an indication of the clients’ stated purposes in coming to the 
Bureau. It will be noted from the table that in the.se respects 
as in all others but one the hypothesis is accepted that the 
groups were drawn from the same population. With respect 
to the significant variable, age, the mean age of the experimen- 
tal group was ai .o years and the mean age of the control group 
was 20.4 years. 

Evidence Concerning '■Types of Test Selection Methods Used 

sSince the data in the present study arc predicated upon the 
assumption that the counselors for the experimental group used 
a method of test selection which allowed the clients to 
make their own choices, it is relevant to examine and test this 
assumption. It should be noted in this connection that many 
subtle factors may be at work during the test-selection process. 
A counselor who is diagnosing the client’.s needs a.s the piocess 
goes on, or a counselor who feels that he has a .stake in 
the client’s selection of any particular test, might easily provide 
a' number of clues, consciously or unconsciously, which might 
be perceived and acted upon by the client. Thus the question 
of whether or not the situation is really a free situation for the 
client comes back to the counselor's underlying intent and 
attitude toward the client and the situation. The best avail- 
able judgment of this attitude and the test-selection method 
used by the counselors would be based upon direct observation 
of the counselor, so that voice inflections and other mannerisms 
might be taken into account. Since this procedure was not 
feasible, the verbatim records (typescripts) of tlie inter- 
views were used as a basis for judging the test selection 
methods used. 

These judgments were secured by submitting to qualified 
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judges* six recorded interviews for each of the two experimental 
counselors and six recorded interviews for each of the four con- 
trol counselors. The judges were asked to read each interview 
and classify the test-selection procedure used according to four 
categories, ranging from complete counselor responsibility to 


TABI.K 1 

Judgments Concerning Test tselection Vtocedures Used by Each Counselor 


Counselor 


A 

B 

C 

D 

E 

F 

Total 


TcrI Sclcrtlon Procc«lurc 


A 

n 

c 

u 

Total 

11 

1 

0 

0 

14 

0 

0 

0 

M 

>4 

0 

4 

8 

2 

14 

1 

3 

6 

,3 

14 

0 

0 

0 

>4 

14 

11 

1 

0 

0 

H 

16 

1 1 

M 

. 3.3 

84 


complete client responsibility for selecting tests. The cate- 
gories were as follows: 

A. Counselor selected te.st.s with no choices made by the client. 

B. Counselor took major .share of re.spon.sihi]ity for selecting 
tests, hut gave client definite opportunity to add to or 
subtract fiom counselor’s list. 

C. Client took definite share of respoiLsibility for selecting 
tests; counselor took .selective role by offering cliicfly tliose 
tests which .seemed to the coun.sclor to be applicable, or took 
persuasive lole in “.selling” one or more tests to the client. 

D Client was given the responsibility for choosing the tests. 
Counselor limited his function to describing the values and 
limitations of each test in a neutral, non-persuasive manner. 

Four of each counselor’s interviews were classified by two 
judges and two were classified by three judges, so that each 
counselor’s interviews received fourteen judgments in all. The 
interviews were submitted to the judges without identifying the 
counselor who conducted the interview. Table a presents the 
results of these judgments. In this table Counselors B and E 
were the experimental counselors, and Counselors A, C, D, and 
F the control counselors. 

The chi-square value for this analysis was 117.94 (d.f., 15), 


*The writer wishes to express npprecintion to Mrs. Vlrginitt H. Bixler, Dr. Edward 
S. Bordin, Dr Herdis Deabler, ana to Dr Paul E, Meenl for their work in judging 
the typescripts. 
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their own tests did not on the averuge select a larger number of 
tests than those used by the control group, but that there was 

TABLK 3 

Proportion of CticilH Choonn^ Ttsts Available for Actuarial Prediction 


Teat Cbuts Apriroprl»lc C'a«i*» Selected 


Gcit'l Selioliutlc Apt, 

32 

in 

Coop. Moth 

(lor cnterinR engineering student's) 

4 

4 

Jolitwon's Science 

4 

4 

Coop. Algebra 

(for entering students in ag., forestry, home 
economics) 

4 

3 

Mo.ss Nursing 

T 

1 

Gordon Fractions 

I 

I 

Coop. Gen ‘1 Sc. 

(entering nurse.s) 

I 

I 

TOTAL 

TABLK 4 

37 


Pioportioii of Clients CImsing Tests Available f’li Clinical Prediction 

Test l»sr« Appropriate 

C’a&cfi Selcilcci 

Interest Test 

4V 

48 

Social Studies 

(for prospective majors in .soclol., iiolir st , 
hist., ccon.) 

H 

7 

Natural Science 

(prospective m.sjors in mecl., dent., bio- 
logical .sc.) 

7 

i, 

Clerical 

(biisinc,ss detail majoi-s) 

5 

s 

English, Expression 
(prospective jlsm., English majors) 

4 

3 

Dexterity 

(pre-dent students) 

4 

4 

Wesley Social Terms 
(entering Jr., business) 

.I 

.1 

TOTAL 

80 

76 

_ . — . 

- 


greater variability in the number 
group selected. 

of tests 

the experimental 
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Evidence of disci imination or non-discrimination in test 
choices may further be obtained by examining the nature of 
client choices for tests which are more useful in some scholastic 
sequences than in others For example, a test in spatial rela- 
tions would be more useful in assessing traits desirable for cer- 
tain technical-scientific occupations than for most occupations 
in the social science areas. Accordingly, two sub-samples were 
drawn from the experimental sample on the basis of membership 
in two distinct groups of claimed occupational choices Group 
I consisted of nineteen individuals in the following classifica- 
tions : pre-college or beginning freshmen students in engineering, 
architecture, and agriculture or forestry, and students in the 


TABLE 5 

Ineidehce af Selection nf Spatial Relations Test in Tiuo Client Siii 
Samples Ip'ithin Ehperimentol Gi uup 



Cirnuii 1 
CTcrhiiKiil 

t:toun2 
(.Sot ini .SriCDLC 

Tolol 


GruuiO 

Group) 


Selected test 

>4 

4 

18 

Did not select test 

5 

12 

17 

TOTAL 

>■; 

j6 

35 


pre-medical and prc-dcntal sequences. 'The second group con- 
sisted of sixteen Arts College students (freshmen and sopho- 
mores) wliose designated majors were speech, journalism, teach- 
ing, economics, business, and personnel work. It is assumed 
that in general the first group would find a test of spatial rela- 
tions more useful than would students of the second group, 
since the attribute of spatial visualization plays a more impor- 
tant part in course work, laboratory, and practice for the first 
group than the second. The hypothcsi.s to be tested in connec- 
tion with these groups is that there was no significant difference 
in the frequency with which the respective groups selected the 
test of spatial relations. The chi-square statistic was used to 
test this hypothesis, 'fiablc 5 contains tlie data which form the 
basis of this test.'' 

■•In tile actual .statl.stlcal cominitatlon, Yulets correction for continuity was made 
by subtracting the value y from the larger numbers and adding .y to the smaller 
numbers, since the small frequencies in the cells would otherwise tend to make X® 
spuriously high. 
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The obtained X® value of 6.411 (i d.i.) is significant at the 
a per cent level. At this level of probability the hypothesis is 
rejected and it may be said that there is evidence of differential 
selection between the two groups. Inspection of the table 
reveals that the technical group chose the spatial relations test 
with significantly greater frequency. This would appear to 
reinforce the notion that clients select the tests in a discriminat- 
ing naanner according to their needs. 


TABl.K 6 

TtJ/ S'e/ectioii Piilltriis nj Ten Clients in Kxf'enmenftil Group 
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XX X 
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X 

X 

X 
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X 

X 

X X 

I’ro-coll. 

home cc. 

X 

X 

X 

X X 

Engin. 

Soph.' advt 


X 

X 



TOTAL 


7 3 


For the reader who may wish to examine patterns of tests 
selected by the clients, the test-selection patterns of ten clients 
in the experimental group are presented in Table 6. The ten 
clients here listed represent every fifth client of the alphabeti- 
cally arranged list of the fifty clients in the group. 

Client Reactions During the 'Test- Selection Process 

This section of the report will observe at closer range the be- 
havior of the clients during the test-selection process. In the 
earlier report by Bordin and Bixler, the authors make the fol- 
lowing observations regarding client behavior at the time tests 
are being selected; “As he [the client] tries to puzzle things out, 
perhaps struggling with anxieties about the possible adverse 
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results of taking a test, the counselor helps him to clarify his 
feelings and to overcome the obstacles to accepting himself” 
(2, p. 364). They state further that: “Each and every test is 
a'^possible stimulant to the client’s discussion of that field or 
phase of his life” (a, p. 36H). 

A study of the recorded interviews indicates the manner in 
which this process of client self-exploration takes place during 
the test-selection process. For purposes of illustration, several 
excerpts are presented here. The excerpts were all chosen 
from the point m the interviews where the mathematics test 
was being described; this was done so that it might be possible 
to observe the vai ying ways in whicli different clients responded 
to the same stimulus In the twelve interviews, five clients 
responded to the mathematics test with a simple positive or 
negative choice and seven clients used the test as a focus of 
discussion, 't'hrce of the excerpts follow, 

Kxcerpt / 

C; Now another kind of test we have heic is .v math test, It 
will give you an idea of your math background, and compaie 
your own background with that of other studeiiEs here. 

S: Well, I had high .school algebra- and that’s my math. So 
perhaps it would be advisable to take tliat and find out where 
I stand in math. Aic they practical problems? Very 
simple algebra I can probably liandle, but when it comes to 
figuring out problems .ind stuff like that — well, I'll take that. 

C: You want to try it, but you don’t think you’re going to be 
very strong m tlic i-ea.soning. 

S: No, I don’t, but then we’ll find out. 

Excerpt 2 

C: This math test would give you an indication of your back- 
ground m math and also help predict how a person is likely to 
do in our College of Engineering. 

S: I’m a little scared of matli. But (pause) that would give me 
an idea of wheie I .stand now m my math background. 
Right? 

C: Inat’s nglit, 

S; Well, I think I've got an idea of wheic I stmid now in my 
math background; It’s one of my weaker points. But I've 
alway.s been told that if I work at it, I could do well in it. 
But I don’t know. 

C: It’s hard for you to know about wliat others say concerning 
your potentialities 
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S : That’s riglit, At times in math, I’ve done very well when I 
applied myself a littb more. But then at other times I 
didn’t do so well and it just seemed like I hated it. And a.s a 
result, well, T got mighty low marks. 

C; You really liad .some ups and dusvns in math. 

S: Yes, that’.s sure. Well, it seemed to make a lot of dif- 
ference as to the instructor I l\ad. .Some would tell me that 
I~ well, III junior high school I was roUl that I was mute 
hopcle.ss with it, and that sort of discouraged me. So I let 
It go for a year and then went to summer seliool tO“-well, to 
do what I’m doing now, to find if I Could do it or not, Well, 

I got a B in it. So my math background now, I don’t think, 

I know just about where I .stand in that, I think. 

C: You feel that the test wouldn’t lie neccs.sary because you 
can .size it up for yourself. 

S: I can size it up pretty well for my.self, that I’m not very higli 
ill math. 

C: Umhum 

S: Well, on the other hand, maybe it wouldn’t be a bad idea to 
Lake it. 

C: You're a little undecided on Uiat one, aien’t you? 

S; Yes ... so I’d know actually just how bad off I am. 

C: So even though you don’t think you’re going to do well on 
it, you’d like to fake it. 

S: Even though I don’t think I’ll do well on it at all. 

Excerpt j 

C; Now we have two tests here tliat arc connected with how a 
student is likely to do in agriculture or forestry. They’re 
an algebra and science te.st. 

S; Oh, I’ll take the science. 

C: O. K. 

S: That isn’t physical chemistry, is it? 

C: It’s pretty general. It doesn’t sound so good now, does it''* 
S: Wei], not if it’s chemistry and algebra because I don’t .seem 
to be at all interested; but I’ll try it. 

C; Just thinking about those things makes you feel ■. 

S: Yes, that’s right. It just gives me an ill feeling thinking 
about having to take those .subjects. I’m w'oirying about 
them constantly, and that doe,sn’t do me any good. 

C: Umhum. And worrying about those keep.s you from 
doing as well as you might in other things. 

S; That’s right. 

C: (pause) Do you feel that you want to take this lest or not? 
S: I’ll take the science test. I don’t want to take the algebra 
test, though. 

C; You feel pretty sure of that, hum? 

S: Yes, pretty sure. 
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These excerpts provide a study both in similarities and con- 
trasts. All of the clients had feelings of inadequacy in mathe- 
matics, yet the degree of self-acceptance which they displayed 
regarding this inadequacy and the extent to which they strug- 
gled with the prospect ol exjiosing themselves to a math test 
were unique with each client. Actually, the whole process of 
test selection appears to afford the client an opportunity 
to come to terms with his own feelings and attitudes and to ex- 
amine these attitudes in an atmosphere where threat or evalua- 
tion by the counselor is at a minimum. 

The final aspect of the present leport deals with the leac- 
tions of the clients to the test-selection process itself. In this 
connection it may be said that the majority of clients who come 
to the Counseling Bureau for vocational counseling expect 
testing to be part of the process. “ Their prior knowledge of the 
nature of the tests varies, but the modal preliminary set of the 
clients is that they will he given a test or battery of tests 
uniform for all clients. When the counselor uses the test-selec- 
tion method here under considciation, many clients give no 
indication of difficulty m working with this situation; others 
find it difficult to deal with a setting which differs from their 
expectations and find it hard also to take the responsibility that 
the self-selection process implies. The relative frequency of 
these alternative reactions may be estimated from the fact that 
in the twelve recorded interviews, eight clients undertook the 
self-selection method without evidence of difficulty or confu- 
sion and four clients revealed varying degrees of indccisiveness 
and dependence upon the counselor. Since these modes of 
reaction will be discussed at further length, it may be worth- 
while to illustrate the operation of each as they occurred in the 
interviews. In Excerpt 4 theclient appears to have no difficulty 
with the process, while in Excerpt 5 the client finds it difficult 
to select the tests. 

Excerpt 4. 

C: 'I'his te.st is a te.st wliich gets at your ability to judge art 
principles. It’.s not a drawing test; it’s a te.st vvheie you 

'Of the 170 client,'! in both experimcnt.il and control groups, 14S checked ns one 
of their leasons for coming to the hureau the .statement, “I w.mt to take the aptitude 
tests so that 1 can find out what vocation to go into " 
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select in eacli case the better of a pair of pictuies just to see 
whether you understand the art principles involved in the 
pictures. 

S: I .see. Well -that wouldn’t have anything to do in the 
line of engineering drawing, though - it wouldn’t help me 
out there, would it? 

C: No, it won't predict liow a guy will do in that. We do have 
a test which lielp.s give you a preiliction of that nature. 

S: Well, I think if I were taking any diawing, it would be some 
kind of engineering drawing 
C: You’ve pretty well ruled out otlier types 
S: Ye.s. 

C: This test (pointing to anothei one) does give some indica- 
tion more along Iine.s of hluepiint, layout work, engineering 
drawing. It gets at your ability to vi.sualize various sizes 
and .shapes of figures, the kind of thing you need when you 
do a blueprint. 

S; I want that one then. 

Excerpt 5 

C: This test will give you an indication of your general ability 
for college work. We find that it helps to predict how you’re 
likely to do in our liberal arts college here. This second one 
us an intelligence test which will compare you witli the general 
run of people; it'll come out witli a comp.ari.son of your intelli- 
gence with the intelligence of the population in general, 

S: Well, I’d ju-st as .soon take them. Is theic any charge for 
them? 

C: No, not for students here at college. 

S: Well, I want to know. What do you tliiiik? I’d just as 
soon take any ones you .sugge.st. Frankly- -•! mean, the 
more I can find out about my.sclf the better I feel- --without 
going too far, that i.s. I mean, not taking every single one 
on the list. 

C; Yeah, That's basically why I’m going through these with 
you, so that you can get an indication of what you can learn 
about yourself; that may help you to be selective about the 
tests you want. 

S: Well, anyway you think, I mean, I don’t know too much 
about the tests. If you think I should have it, I’ll take it. 
I don’t know — I don’t think--! don’t care — if I have to take 
it I’ll take it. If you think I should take it, I’ll take it; put 
It that way. 

C; You’d like to depend on my judgment in this. 

S: Yeah, that’.s right. I mean, taking te.sts like this doesn't 
bother me. 

C; Well, the information is going to come to you eventually 
and you’ll be the one to use it. I’hat’s why I’d like to make 
this a cooperative venture and wliy I’m not just laying 
out a bunch of tests. 
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S: I’ve always wanted to take that test. I think I should. 

C: You’d like to find out where you stand — 

S: Yeah, I think I would 

C: All right, Would vou like me to check it? 

S: Yeali. 

It will be observed that in Itxcerpt 4 the client apparently 
knew what he wanted and specified the type of judgment he 
desired. In Excerpt 5, the client found it difficult to accept 
responsibility for selecting the tests and attempted to place 
this responsibility upon the counselor. It is interesting to re- 
flect upon the implications of this kind of reaction for the more 
inclusive adjustment patterns of the client. Two alternative 
possibilities present themselves. The fiist is that the client’s 
indecisiveness is specific to the test-selection situation; the 
second is that such indecisiveness in selecting tests is associated 
with indecisiveness in other areas of behavior and perhaps sim- 
ply a leflection of a more inclusive problem of adjustment. 
These altei natives may be formulated in terms of a testable 
hypothesis based on the use of the recorded interviews. Spe- 
cifically, the hypothesis to be tested is “Do clients who show de- 
pendence and indecisivenes.s in selecting tests also reveal more 
indecisiveness in other [ihases of the interview?’’ In order to 
test this hypothesis, the twelve interviews were first placed in 
random order and a count was made of the number of client 
responses in each interview which indicated general indecisive- 
ness or confusion of purpose.® This procedure was earned out 
independently by the writer and another judge. It will be re- 
called that four clients sliowed indecisiveness in selecting tests 
and eight did not. The interviews were divided into two groups 
on this basis and the frequency of signs of indecision was com- 
puted for each group. Table 7 indicates the count arrived at by 
each judge and also the pooled count (average; on which the 
computation and test of significance were based. It appears 

® Inclecisivcne.ss rcunrclitiB twt .selection was not included, .since this phenomenon 
served a.s the criterion for distingui.shing the groups. Kxaniples of client responses 
revealing indeclsivcne.ss nre: 

A. S; Maybe I'm going at this thing the wrong way. I can’t forever jump from 
one field to nnothei l)cciiu.se it'll never get me anywhere. I’ll never get through if I 
keep jumping around. 

B, vS, Yes. I mean, I had alway.s imagined that when you were getting ready for 
marriage that — well, it .should be jiust the very ultimate. That is, if it does come to 
the day when she’.s walking up the aisle and I can look at her and feel exactly what I 
wanted and exactly what I expected, well, I think that would be a very good way to 
get started. You see what I mean — 1 should be a little more sold on the idea 



344 I'D-UCATIONAl. AND l'SVCHOI.OtnCAD MEASURKMENT 

that in these interviews the criterion "signs of indecision” was 
an objective one, since the rank correlation of the independent 
judgments was .g8. 

A preliminary F-test of homogeneity of variance indicated 
that the two groups were homogeneous in this respect; there- 
fore it was possible to pool the sums of squares for the 
two groups in computing the t-valuc. For this analysis, the 
t-value of is significant at the level The table in- 
dicates that the mean number of signs of indecision for Gioup i 
was 4.3 while the mean for Group a was 11 H75, over two and 
one half times as large as that for Ciroup i. It may thus be 
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said that the clients who showed indecision in selecting tests 
also displayed a greater incidence of indecisiveness in other 
parts of the interviews not related to the test-selection process. 
To the writer it seems that these signs of indecision on the part 
of the clients who found it difficult to select tests were but a 
reflection of a more basic insecurity and confusion of purpose— 
an insecurity which made it difficult for them to work out solu- 
tions either for the test-selection situation or for the other prob- 
lems they faced, This phenomenon of pervasive indecisiveness 
seems to be in accord with the .concept of vocational counseling 
stated earlier — namely, that the manner in which an individual 
approaches vocational solutions is a function of his total pre- 
vailing level of adjustment. To the extent that this is so, the 
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phenomenon of ambivalence and conflict in making test choices 
offers tlie same challenge and potential for therapy as a problem 
in any other area of per.sonal adjustment, and may well be con- 
sidered an integral part of the process of counseling. 

Returning now to the relation between the general principle 
of self-selection and the data educed in the present study, it may 
be said that the data here jircsented appear to be in harmony 
with the self-selection theory. This conclusion must be seen in 
tentative terms, since alternate theoretical explanations of the 
present phenomena were not ruled out. However, it does ap- 
pear from the data that clients do take a free situation 
and utilize it in terms of their own needs. 

Smnmary 

This paper has presented a study of client self-selection of 
tests in vocational counseling. The method of test selection 
here considered is based upon the assumption that it provides 
the possibility of self-exploration and consequent growth ex- 
perience for the client. 

Two questions raised by the use of this method weie here 
explored; first, what kinds of test choices do clients make? 
Second, what kinds of uses do they make of the interview dur- 
ing the test-selection process? Data obtained relative to these 
questions were as follows: 

I. Clients selected tests available for prediction in 93.2. per 
cent of the possible cases. 

1. The discriminating nature of the test selections was fur- 
ther indicated by the facts that the clients chose an average of 
5.71 tests out of over twenty-five available tests and that in 
the case of the spatial relations test the group of clients in 
technical sequences chose the test significantly more frequently 
than did clients in social science sequences. 

3. Client reactions during the test-selection process varied 
from client to client. The test presentation appeared to serve 
as a stimulus sufficiently unstructured in nature to evoke in the 
client those reactions which his own background and attitudes 
dictated. 

4. Clients varied in their reactions to the test-selection 
process itself. Those clients who displayed indecision in select- 
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ing tests also revealed a greater incidence of indecision in other 
phases of the interview. 
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A NOTE ON RAVEN’S PROGRESSIVE MATRICES 

TEST* 


n. J, A. RIMOLDI 
University of Chicago 

IntroducHo?! 

The main object of this note is to give some information 
about Raven’s Progressive Matrices, wliich may be useful for the 
practical psychologist We shall first describe the test, refer 
to some of the statistical values obtained during the process of 
standardization (7, 8) and compare these values with those ob- 
tained by other authors. A description of its factorial composi- 
tion as obtained by including the test in a large battery and a 
study of the results of the introspective data that we have 
available will help the reader to form an opinion about the 
psychological functions active during its performance. 

'The Test 

Raven’s Progt'essive Matrices is a series of sixty items divided 
into five sets: A, B, C, D and E, whose difficulty increases with 
a certain regularity from item i in Set A to item la in Set E. 
The test is non-verbal and suitable for measuring intelligence 
above six years of age (4) . 

Each page of the booklet contains in the upper part a pat- 
tern in which a part is missing. At the bottom of the page 
several numbered pieces of the same size and form as that of 
the missing part are arranged m two rows, Of all of these, 
only one completes tlte pattern. 

The subject may record each answer by writing the number 
of the chosen piece on an additional piece ofpaper, or may either 
vocalize or point to the correct answer with the fingers or any 
instrument when the test is taken individually. There is an 
equivalent form of the test for blind persons in which the 

* Copies of the test mny be secured from H. K. Ixwis nnd Co., Ltd., 136 ( 5 ower 
Street, W London W.C. 1, England. 
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patterns arc replaced by carved pieces reproducing the same 
problems. 

By this description of the test, it i.s obvious that it does not 
depend to any large extent upon the education tn- amount of 
information of the .subjects, that it can be easily applied to 
foreigners, and to normal or physically or mentally defective 
children (6). The test has been used sucre.ssfuliy by Tracht 
(n) in testing cerebral palsied with ditferent degrees of physical 
impairment. 

All of the drawings are clearly prc.scMtcd in black and white. 
The instructions are short and simple, and the subject is asked 
to find which of the pieces comjdetes the larger pattern. He 
is asked to work all of the problems without hurrying. Fur- 
thermore, there is no time limit. The mean time for a popula- 
tion of 1680 subjects between 9 and 15 years of age was 38 
minutes with a S. I), of 1 r.90 (8). 

Statistical J ' nines'^ 

The maximum possible score is 60, there being one mark for 
each item correctly solved. 

Tabic I gives the means and standard deviations for our 
subjects in different ages and different conditions of testing, 
We shall not give here all of the values obtained in our stand- 
ardization of the test. Tho.se interested in more statistical 
details are referred to the author’.s previous papers (7, 8), 

By analyzing the percentile values given in the aforemen- 
tioned articles and comparing them with those obtained by 
Raven (5) the reader will find out that in spite of different 
environmental and educational conditions there is a consid- 
erable agreement in the results. This agreement holds both 
for individual and group testing. 

The differences at each age level between the lower and higher 
percentiles — either for Individual or group testing“-is quite 
constant in the Argentine results; and the curves for all of the 
percentiles obtained by means of group testing show a fairly 
even trend, apart from a few irregularities, probably related 

_ ’ The populations mentioned herein were comtxiscd of cliiidren in Mendo/a, Argen- 
tina, studied between the yews 1941-1946. The form of the test here employed ms 
the Progreiiioe Matrices /pjj (4). 
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to[biological factors and to the effect of selection of the popula- 
tions (7, 8). 

The individuals at a higher level develop more regularly 
than those below the median in the ability or abilities required 
to solve the test. The less endowed individuals show a slower 
trend of improvement. 

The values obtained from group testing are on the whole 
slightly higher than those from individual testing. 

There is a drop in the mean number of problems solved from 
Set A through C, there is no significant difference between the 
means for Set C and D, and there is a final drop in Set E. 
This may be further explained later on, when studying item 
difficulty. 
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Item Difficulty 

A comparison of Elalstead’s results (i, Table 7) with those 
of Rimolcli et nl. (7, Tables l and 8, Table 5) reveals that the 
items do not increase in difficulty according to the presentation 
of the test. It can be seen that while the items of the last 
set are the most difficult ones, those of sets C and D appear 
scattered through the whole scale of difficulty. 

Comparing the over-all difficulty of the items with the order 
of the problems as given by the author of the test, it is evident 
that while sets A and E are better limited, sets C and D have a 
greater scatter. 

litudy of the Errors 

By the study of the most frequent mistakes for each item 
(7, 8) and its comparison with the report of Elalstead (i) on 
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the same subject, one cannot fail to observe a similarity be- 
tween the findings. 

On the wliole the opinion of the testee.s is favorable toward 
the test. It is quite obvious that they arc interested in the 
problems since only a few of them fail to complete the test. 
In the younger children when the problem.s become more dif- 
ficult there is a tendency to give up. which sometimes manifests 
itself by the casual way in which they reucli the solution or by 
their repetition of the same answer time and again, a tendency 
also reported by Haven (6) in mental defectives. 

Perceptual ability is imjxjrtant in the first two sets of the 
test. Frequently the wrong answers seem to indicate a faulty 
perception of the figure-field configuration. In Set B the 
attitude of the subject.s is moic analytical, altliough strong 
gestalt forces influence tlic solution of the problems. Often the 
wrong answer in this as in the following sets, especially that of 
E, seems to indicate that the subjects tend to work the solution 
in certain fixed spvVtial directions. 

Sets C and D require a more complex type of activity on the 
part of the subjects. For example, .some report ‘'seeing the 
figures animated of movement.” 

In Set K it is not infrequent for the subjects to reach the 
.solution by employing clearly analytical and algebraical pro- 
cedures. 

In addition to the above-mentioned way.s of solving the 
problems, it is found that .some subjects resort to all manner of 
manipulation with their hands when w'orking the difficult 
items, others are guided by esthetic reasons, and still others 
give as the correct answer the most complex of the possible 
replies — findings that have been previously reported by Hal- 
stead (i) and by Raven (j). 

Experience indicates that, on some items like D8, Bii and 
E8, the subjects reveal a wide variety of reactions, amounting 
sometimes to an obvious blocking. 

Factorial Study of the Test 

The five different sets of the test were included as separate 
variables in a battery in which some tests of performance, 
memory, cancellation and so on were present (9). 
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The results of the factorial analysis should be interpreted in 
terms of the special test configuration. Probably if the test 
were included in other batteries, other factors would contribute 
as well to its variance. 

There is one factor common to all of the sets of the Raven, 
and to them only. Although it is difficult to interpret it 
clearly, one may well regard it as similar to Thurstone’s factor 
I (10), insofar as all of the items require the discovery of a rule 
or principle for their solution. 

Sets A, B, and C are loaded in a factor described as the per- 
ception of relations in space necessary for the construction of 
a whole. The fact that Set A, and to a lesser extent Set B 
are here present, confirms our opinion of the influence of 
perceptual and gestalt forces in the solution of the first two 
sets. Sets C and D seem to require this activity to a lesser 
extent. 

Set B has a small loading in factor C, which is related to the 
construction of configurations against disturbing forces. 

Set E is present with a small loading in factor D, a factor 
which has been described as related to the perception of right 
and left. In the most difficult items the solution is sometimes 
obtained by pointing to the pieces according to their position 
more than to their value for the solution of the problems, a fact 
also described by Miller and Raven (2). 

Set E is also loaded in a memory factor. Sets D and E have 
saturations in a factor related to speed of perception. 

Sutn^nary 

The comparison of the values obtained by th^^ministration 
of Raven’s Progressive Mah'ices in different popuhttions, dif- 
ferent countries and different testing situations, shows that 
there is a strong similarity between these different studies. 

For the reasons adduced in the previous paragraphs we recom- 
mend its use when the psychologist is interested in employing 
a non verbal test, well graded in difficulty, with good discrimina- 
tive value and applicable to a wide age range. Moreover, 
the test can be applied to normal and handicapped subjects. 

The loadings of the different sets in the different factors re- 
lated to perception, construction of wholes, memory, relations 
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of riglit and left, speed f>f pcrcejitioii and a non identified fac- 
tor, seem to play a considerable part in tlie actual solution of 
the items. 

As .some of these factors have been identified as similar to 
those found in other studies (()) with dificrent batteries and 
different .subjects, wc suspect that they are basic components 
of psychological dynamics, beyond the mere presentation of 
the problem. 
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INDIVIDUAL DIFFERENCES IN SPEED OF RESPONSE 
IN MENTAL TEST MATERIALS OF VARYING 
DEGREES OF DIFFICULTY' 

MERLE W. TATE 
Hamilton College 

Beginning with what became known as the '‘personal equa- 
tion” controversy regarding error in recording stellar transits, 
individual differences in speed of simple and complex response 
have been a subject of perennial interest and inquiry. The 
amount of research and controversy indicates both the im- 
portance of the subject and its elusiveness. 

The persistent investigation of the significance of speed differ- 
ences has taken six main lines of inquiry, several of which con- 
nect at one or more points. The earliest studies were those of 
the psychophysicists and dealt with simple reaction time in 
connection with sensation and other simple psychological 
processes. 

The use of reaction time as a measure of intensity of sen- 
sation led to a vSecond type of inquiry which was concerned with 
the effect of various conditions or factors, both internal and 
external, upon speed of di.scrimination and decision. In these 
studies it generally has been observed tliat the speed of correct 
judgments tended to be greater than the speed of incorrect ones, 
although there has been some adverse evidence. 

The development of correlation technique at about the be- 
ginning of the 20th century encouraged a third type of study, 
the chief concern of wliich was the relation of simple and serial 
reaction time to school marks, performance in various intel- 
lectual tasks, and imputed intelligence. 

The introduction of standardized group testing following 
World War I and the almost universal adoption of time-limit 
instead of either work-limit or untimed procedure in group test 

' This paper Is a summary of the thesis presented by the writer in partial fulfilment 
of the requirements for the doctorate at Harvard University, June 1947. 
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administration raised an issue regarding the significance of speed 
of response in test performance and led to extensive investiga- 
tion of wliether speckled mental tests discriminated against 
individuals who ''might be slow yet profound." 

A little later Thorndike and his students advanced the hy- 
pothesis that the ditnension.s of intellect included speed, width, 
and altitude. The hypothesis motivated a series of studies of 
the relation between the three, .studies which connect with sev- 
eral earlier investigations of the relation between rate of work 
and quality or accuracy, 

The studies of the relation of rate to quality of work led 
naturally to the question of constancy of rate in complex re- 
sponse, i.e., the question of wliether an individual who was fast 
in one intellectual task tended to he fast in others. As early 
as igoo tlie existence of a special speed ability in certain asso- 
ciative and jierceptivc processes was jiostulated, but research 
on the point was desultory for the next twenty-five years. 
With the development of factorial analysis (echniques, how- 
ever, the possibility of speed as an imiependent aliility became 
of immediate concern, and during the last two decades the 
majority of specil stuilies have directly or indirectly considered 
the possibility, 

Despite the great number of investigations along each of the 
last four lines, few hypotheses regarding the role of speed in 
intellectual response have been generally substantiated. The 
evidence has been conflicting. The more discriminating the 
research, the more obvious it has been that trustworthy data 
are hard to obtain. It docs appear, however, rhat three con- 
clusions can safely be drawn. 

When measures, experimental conditons, and sample size 
have been adequate no appreciable relationship between speed 
in simple and serial reaction time and test intelligence has been 
found. The studies reporting significant relationship have em- 
ployed subjects extremely lietcrogcncous as to chronological 
age or have been characterized by inferior altitude tests, crude 
measurement, or small samples and inexact statistical test, Tt 
appears certain that reaction time and test intelligence vary 
independently. 

Although there is some conflicting evidence, it may be con- 
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eluded that group tests are not necessarily damaged by the im- 
position of time limits. In general, the scores in limited and 
unlimited time correlate highly and the scores in limited time 
show satisfactory correlation with other criteria. Much of the 
research on the point has, however, been trivial. Time limits 
for most group tests arc established experimentally. The corre- 
lations between limited and unlimited time scores, frequently 
cited in support of the conclusion that speed may be identified 
with altitude, warrant, in view of the overlap or the part-whole 
circumstance, only the piosaic conclusion that time limits do 
not vitiate particular group tests. The improvement of corre- 
lations between group tests, with time limits removed, and 
other criteria has in general been no greater than would be ex- 
pected due to the lengtliened test. 

The great weiglit of evidence indicates individual consistency 
in speed of response to a wide variety of mental test material 
of a low order of difficulty. The hypothesis of such an inde- 
pendent ability in speed in dealing with easy tasks is well sup- 
ported both by correlations between direct measures of rate of 
work and by analyses of ilie intercorrclations of scores on 
speeded tests. Little is known about the nature of the factor, 
although it commonly has been described cither as an aptitude 
or as a set for perceptual speed. 

The evidence regarding the relation of speed to accuracy or 
quality and to altitude is particularly confusing. Several in- 
vestigators have been able to identify speed with altitude in 
particular functions, and several have found significant corre- 
lation between speed and general test intelligence, About the 
same number have found only chance correlation. The time 
spent on achievement or mental tests generally has been found 
to be inversely related to the cumulative accuracy scores; the 
correlations may tell nothing, hoivever, except that it takes 
longer to make errors. Significant correlation between speed 
and accuracy in arithmetic computation, speed and compre- 
hension in reading, etc., usually has been found, but here again 
speed and quality have been measured simultaneously without 
a control of accuracy effiect. 'Hie significant correlation re- 
ported between speed measured in low difficulty material and 
altitude measured in supposedly similar material of higher diffi- 
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culty may be due to signilicant relation between the two. On 
the other hand if, as some invcstiuanm.s liiive concluded, the 
duller subjects orient themselves more slowly in speed tests the 
correlations may be meaningless. 

The majority of the inconsistencies and contradictions m 
previous studies may be accounted for by different methods of 
studying mental speed, dissimilarity in units of measurement, 
unreliability of measure.s. inadecpuitc methods of controlling 
motivation, difficulty, anti accuracy effects. 

If two or more individuals resptmded to the same test items 
with the same degrees of accuracy, tlieir performances could be 
compared simply and precisely on the basis of speed of response, 
Unfortunately the experimental control of accuracy of response 
results Inevitably in te.se items of low difficulty, indeed, if de- 
fined in terms of percentages failing, in zero difficulty. Mental 
tests consisting of sucli items cannot be thought of a.s measuring 
anything except speed, since there would be i\o way of de- 
termining what else they measured, and provide no basis for 
generalizations regarding speed in different functions or in tasks 
of greater tlian zero difficulty. 

Little is known about the effect of inaccuracy on speed of 
response, but it is reasonable to suppose that inaccuracy, like 
indecision in less complex response, dampens speed. I'lie sup- 
position is well supported by the numerous reports of negative 
correlations between cumulative accuracy scores and total times 
spent on tests. The supposition clearly is subject, however, to 
a qualifying provision. If an item were unintelligible to an in- 
dividual a speed score miglit indicate nothing more than the 
time at which the individual judged it respectable to guess at 
the answer or to omit the item. 

Neither total time spent on a test nor cumulative accuracy 
scores on a speeded test of greater than zero difficulty permit 
control of accuracy effect and neither provide the data needed 
for examination of the reliability of the speed measure. 
Furthermore, both measures, since they arc affected by time 
loss due to gross irrelevancies such as picking attractive items, 
are at best crude approximations of speed of response. 

Such considerations suggest that in a .study of mental speed 
the test items should be selected to tap several dissimilar abil- 
ities, cover a wide range of difficulty, elicit at least two correct 
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and two incorrect responses from each subject at each level of 
difficulty under investigation, and should be timed individually 
Other desiderata include (a) moderate length items requiring 
on an average of, say, lo to 50 seconds, since errors m timing 
and the time differences ascribable to different rates of reading 
the stimulus material and writing the responses would be pro- 
portionately greater in shorter items, while gross distractions 
and irrclevancies would more likely arise in longer, (b) “open” 
or completion items, since multiple-choice items likely would 
encourage guessing under time pressure, (c) items relatively in- 
dependent of school experience to minimize familiarity and 
practice effects, and (d) subjects relatively homogeneous as to 
chronological age, school progress, race, and motivation, 

The Method of InvestigaHon 

This study, designed in light of the above desiderata, was 
made to determine (i) whether speed of response to mental test 
Items of varying degrees of difficulty, with accuracy effects con- 
trolled, differentiates between individuals and (2) whether there 
is a factor of speed independent of altitude and independent of 
the function in which it is measured It will be seen that the 
questions are basic, for tlicy relate both to the possible ex- 
istence of mental speed as an independent ability and to the 
reliability of direct measures of it. 

The study was limited to a sample of thirty-six high-school 
sophomores and juniors having a mean chronological age of 
188.4 with standard deviation 017.4 and a mean mental age, 
as measured by tlie California Test of Mental Maturity, S~Form, 
of 2,18.7 with standard deviation of 16 7 The sample appeared 
to be normal with respect to test intelligence and school achieve- 
ment. It was selected at random from the writer’s mathe- 
matics classes in tire Belmont, Massachusetts, High School. 
All members of tlie sample were enrolled in the college pre- 
paratory curriculum. Fourteen were girls and twenty-two 
were boys. Sex differences in sentence completion accuracy, 
favoring the girls, was significant by the /-test at the 3 per cent 
level, but the other differences in speed and accuracy were such 
as would be expected in sampling from a population in which 
sex differences were in fact zero. 

The desirability of a random sample of Belmont high-school 
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sophomores and/or juniors was juducd less than the desira- 
bility of obtaining a sample of interestcti and similarly moti- 
vated individuals willing to give the three to five hours required 
by the tests and amenable to nt-tessarily rather inflexible sched- 
ules. Although the sample appeareil entirely representative of 
Belmont sophomore and juniors ami representative of such 
students in any uppcr-middle-class, suburban high school, the 
population it specifies must be considered hypothetical. 

Preliminary investigation had indicated that speed of re- 
sponse to typical arithmetic reasoning, "find the mle and com- 
plete the series" number scries, CA\'D type sentence com- 
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pLetion, and Army Beta spatial relations items significantly 
discriminated between individuals. Although the abilities 
elicited by such items of a wide range of difficulty are by no 
means independent, they w'cre judged to be sufficiently dis- 
similar to demonstrate the presence rir absence of a general 
speed factor. 

The majority of the sixty-four arithmetic reasoning and the 
sixty number series and sentence completion items finally used 
in the study were selected from various well-known mental 
tests’*; in order to get the range and levels of difficulty desired, 
however, it was nece.ssary to construct about twenty items for 

’ The Ol/j, Htnmon^Nehon, ACE PsycMogical Examinations, ^Ehorndike CAf^D 
Scales, Kuhlman-Anderson, and the Cahjorma Test oj Mental Matarily, Long Forms. 
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each test. The spatial relations items were adapted from the 
Army Beta and the JCelley® tests These consisted of outline 
geometric figures to be divided into specified parts. All items 
had the benefit of try-out on a sample of nine individuals com- 
parable to the subjects in the final sample. The levels of diffi- 
culty, in terms of percentages of final sample failing, demarked 
by the items are shown in Table i. 

The tests were given during the Christmas holidays of 1945 
and the two week-ends immediately following In connection 
with the perennial class-room question of whether time-limit 
tests are fair to all students, the study had been explained to 
the subjects. At the time of taking the tests, each subject was 
told that his score would be based upon both speed and accuracy 
and he was asked to do his best in both respects. Each test 
was prefaced with rather extensive practice materials. 

The arithmetic reasoning and number series completion items 
had been typed on individual cards and were presented in se- 
quence, the subject writing his answer and the time announced 
by the examiner on the answer sheets. It had been observed 
m the try-outs that the tendencies to re-examine items or to 
perseverate were obviated by having the subject record his own 
time while the examiner got ready to present and time the next 
item, the latter, of course, checking on the correctness of the 
entry. 

The sentence completion items had been duplicated, and a 
screening device which could be slipped down the page was used 
in presenting them. The spatial relations also had been dupli- 
cated, and the stimulus material, i.e., the parts into which the 
figures were to be divided, was presented on cards. The time 
spent on each item was recorded as in the arithmetic and 
number series tests. 

No attempt was made to influence methods of work in the 
arithmetic test. Some of the subjects performed more of the 
tasks mentally than others. Whether time differences due to 
figuring the answers to some of the harder items on paper sub- 
stantially affected speed or accuracy was a question which could 
not be answered from the data. Some of the faster subjects 

* Truman L. Kelley. Crossroads in the Mind of Man. Stanford University, Cali- 
fornia: Stanford University Press, 1928, p. 190. 
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figured cm paper, as did staiic (»f the less accurate. Several of 
the sul)jects worked stmie fd' the harder lumiher series on paper, 
hut in that test, ti/f). there appeared tn he no a.ssociation be- 
tween methods of work and perlorinancc. Tlie test.s were 
given in the order indicatcsl in ‘rahle l 'Fhe testing periods 
required hy difierent .subjects varied from about three to five 
houns. Althnuuh the majority td' the .suhjei'ts complained of 
being tired at the end of their periods, it is not likely, judging 
from research on the point, that speed or accuracy was ma- 
terially aftected hy tireilness. 

In scoring the te.sts. responses were counted right or wrong. 
The decision to .score the .sentence conqdetion itein.s in the "all- 
or-nonc" manner came after .an investigation of the conse- 
quences of u.sing a partial credit scoring .system. 'Hie rank 
order correlation coefficient between the systems wa.s .c/i, and, 
in the interest of .simplicity and uniformity in adjusting .speed 
scores for accuracy, the "all-or-none" scoring was used through- 
out. 7 'he rcliahilitie.s of the te.sts, .scored for accuracy, esth 
mated from odd-cven halves were witliout step-up, arithmetic 
.fig, number scries .HK, sentence coiuplecioit .Ho, and spatial re- 
lations ,86, 

The subject's .speed of rc.spon.se to an item was mea.sured by 
the number of seconds taken to complete the item. The re- 
lation between speed as ordinarily definetl anil the .speed scores 
employed tlius was invcr.se, tl\c scores being really direct meas- 
ures of slowne.ss. An omission before time wa.s called was 
treated as an incorrect respon.se. 'Fhi.s procedure introduced 
an uncontrollable .source of error, hut the alternativc.s either of 
estimating speed scores for omitted items from subject and itenr 
mean times, or of deleting the items upon which there were 
omissions, were judged w'orse. The former w'ould have resulted 
in a I0.SS of independence, and the latter in the In.s.s of most of 
the items of abo\'c about 40 per cent difficulty. 'Fhe use of 
multiple-choice instead of “open” items probably would have 
eliminated most of the omissions, hut for reasons already noted 
the latter were judged preferable. In a few cases, it was neces- 
sary to impose the three-minuic time limit which had been set 
to speed the administration of tlie tc.sts, but these arbitrary 
scores were not used in the analyses of speed differences. 
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The basic data for the study were the 244 speed and the 244 
accuracy scores of each subject, 64 in arithmetic reasoning and 
60 jn each of the tliree other tests. 

^he Appropriate Unit of Measurement 

Tlie two basic assumptions supporting variance ratio sta- 
tistical tests are normality and equal variability in the parent 
population (s). Inspection of the speed scores, expressed in 
clock or raw time in seconds, indicated that neither assumption 
likely was tenable. All of the 144 frequency distributions of 
the thirty-six subjects in the four tests were positively skewed. 
In the majority the skewness, characterized by / 3 i values in 
excess of +2,. 5, was severe enough to raise doubt concerning 
the propriety of variance ratio tests. 

The four distributions of each of two subjects among the six 
liaving the highest cumulative accuracy scores for the battery, 
those of two among the six having the lowest, and those of five 
among the remaining twenty-four were randomly selected for 
further investigation of the normality and homogeneity as- 
sumptions The extent of correspondence between each of the 
thirty-six selected distributions and a theoretical normal dis- 
tribution was evaluated by the familiar CJri-square criterion. 
The probabilities that tlve observed distributions would arise 
in sampling from normal populations were extremely small, 
twenty-five being less than .001 with P < 00001 on the aggre- 
gate in each function, and it was concluded that the samples of 
raw time scores were not of normal parentage. 

The distributions of the common logarithms of the raw time 
scores were examined in similar manner, All yielded proba- 
bilities of .05 or greater, the probability on the aggregate of the 
eight arithmetic reasoning log time distributions being .46, num- 
ber series ,27, sentence comiDletion .78, and spatial relations .19. 

In addition to preserving independence of the speed scores 
and normalizing the distributions, the log transformations sub- 
stantially contributed toward equalizing the within-subject 
variances. The Lx criterion (4) indicated that the hypothesis 
of homogeneity of population variances, highly discredited by 
the raw time samples in all four functions, was much more ac- 
ceptable (P> .01) for the log time samples. 
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The thirty-six raw time and thirty-six log time distributions 
which had been selected for examining the normality and homo- 
geneity assumptions appeared to be representative of the re- 
maining distributions, and it was concluded that log time was 
the appropriate unit of measurement. Accordingly, all speed 
scores were converted to common logarithms, rounded to two- 
place mantissas and. to eliminate tleciinals, multiplied by loo, 
The log time scores were used in all later analyses. 

As a matter for speculation, the demonstration of the appro- 
priatene.ss of the log time unit for measuring speed of response 
may have implications beyond the scope of this study. Dis- 
tributions of test performances, however measured, obviously 
are affected by the talent ot the subjects and the nature of the 
items. But in view of the range of talent and the spread and 
types of items in the four functions umier consideration -— three 
of which arc fairly dissimilar the findings may have consider- 
able generality. I'he evidence is intriguing and would .seem to 
add support to the general hypothesis that raw stdur time is not 
an appropriate unit for measuring time dimensions of living 
matter (3). 

Htgnificancc oj Individual DiJftrenct’S in Spead oj Response 
With Difficulty and Accuracy lijjccts Controlled 

The means of the log .speed .scores of correct and of incorrect 
response of each subject at difficulty levels ^ and 3 (sec Table i) 
provided unbiased estimates of bis .speed in responding cor- 
rectly and incorrectly at those levels of difficulty. With the 
exception of four subjects^ who missed no spatial relations items 
at level a, each subject thus had four scores in each test. Six 
of the subjects had only one incorrect response at level 1 in one 
or another of the tests; their estimated speeds of incorrect re- 
sponse at that level, based upon single scores, may have con- 
tained large error. Rough approximation of the standard 
errors attaching to the other scores indicated that they ranged 
from about a to 15 with the great majority lying between 5 
and 10. 


The four subjects were not included in the annlsMs of the vtirmtion of the .spivtial 
scores, rhe nlternative would have been that of Uhclmuting the missing scares from 
inaividufll, levelj and accuracy means at loss of independence. 
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The scores were considered linear functions of the true speed 
of the subjects, speed ascribable to the difficulty of the items 
and to the accuracy of responses, and speed ascribable to the 


TABLE a 

EsHmated Speed nf Correct and Incorrect Response at ‘Two Levels oj 
Difficulty in Arithmetic Reasoning 
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tesl-ing the significEUicc of the individual or subject, difficulty, 
and accutacy factors the general statistical test of linear liy- 
potheses developed by Kolodziejczyk (2) was used. That test 
in situations like the present, i.s equivalent to the familiar Fisher 
variance ratio test of differences between means and, like the 
latter, assumes homogeneity of the residual or criterion variance 
in the population sampled. The assumption was tested by the 
Li criterion (5) and was found entirely tenable (.80 >/■’>. 20) 
in all four functions. 
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The results of the analysis of the variation of the speed scores 
are entered in Table 3. The variance ratios obtained by com- 
paring estimates of population variance provided by subject, 
level, and accuracy mean squares to the residual or criterion 
mean square in each function arc shown in parentheses in Table 
4. Had it been possible to include all thirty-six subjects in the 
analysis of variation of the spatial scores, the ratios in that 
function almost certainly would have been augmented. 

With the exception of accuracies in arithmetic reasoning, all 
differences were highly significant, the probabilities being ex- 
tremely slight of observing such differences in sampling from 
a population in which the corresponding true differences were 
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zero. Close approximation of the probabilities were obtained 
by Kelley’s (i) cube root transformation of the variance ratios. 
These are shown in Table 4. 

Tire insignificance of the accuracy factor in arithmetic rea- 
soning was surprising. Judging from the answer sheets, there 
had been a tendency to oversimplify some of the items and to 
work easier problems than those posed. Then, too, the arith- 
metic items were less easily' checked than those in the other 
tests and may have elicited fewer attempts to replace doubtful 
answers with better ones. But whatever the explanation, the 
circumstance did not appear to introduce any sort of systematic 
effect on the performance of the subjects. 


TABLK 4 

Probabilities ^hat the ObserocA Thfferences in Speed IVonld Atise in Sampling 
from a Papulation in IF/iic/t the 'true Differences IPeic Zero 


Funclion i 


DilTcrctiLM llclwccn 


Sulijccls 

I.cvcl.4 

Accuracies 

Arithmetic Reasoning | 
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, 000000000-1 ■ 
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In the above analysis, the estimated speed scores (illustrated 
in Table 1 ) w'ere means of specified subsets of observed scores 
and were therefore partially free from the effects of within-sub- 
ject variability. As has been noted, these means were charac- 
terized by relatively large error. It was desirable to ask 
whether the variation of true scores or of subject means was 
significantly greater than the variation of observed scores about 
subject means. It will be seen that the question related to the 
reliability of the speed measures, since all questions of reliability 
may be reduced to tire single one of wliether estimated true- 
score variation between subjects is significantly greater than 
the variation of observed scores within subjects. 

Due to varying numbers of correct and incorrect responses 
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at the two levels of difficulty, an analysis of observed scores 
classified as illustrated in Table a would have been a matter of 
great complexity, It was judged more practicable to adjust 
the observed scores for accuracy effect. Sixteen items were 


TABLK 5 

Spetd Scorts Independent n/ .Iceuracy on Seeeii 
y to II Per Cent Difficulty 
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selected at difficulty levels 2 and 3 in each of the four tests, 
■and the effect of accuracy was cancelled, at a loss of only two 
degrees of freedom per item, by computing tlie residuals of the 
scores from the regression line of speed on accuracy in each 
Item. To eliminate decimals and negative signs, each residual 
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was rounded to a whole number and added to 100, For pur- 
poses of comparison, since it is known that a speed factor is 
elicited by easy mental test materials, the speed scores on all of 
the items of level i difficulty in each test were similarly ad- 

TABLE r. 


.iiialysis of Vaiialioii of Spetii ffcnres Indeptndem of Accuracy at Thee 
levels of Difficulty in Four Mental Function] 
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justed. Due to the process, the speed scores became independ- 
ent not only of accuracy but also of item, level, and function 
effect, the only variation remaining being then ascribable to 
differences between and within subjects. The classification of 
the adjusted scores is illustrated in Table 5. 

The results of the analysis of the variation of the adjusted 
speed scores in each of the twelve sets are shown in Table 6, 
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All of the variance ratios shown in the right liand column indi- 
cated that the hctween-suhjcct differences were highly signifi- 
cant. By Kelley's (i) cube root transformation the proba- 
bilities that the differences indicated by the variance ratios 
would arise due to sampling, if the true dilferences were zero, 
ranged dfiwnward from about i in 100 thousand to less than 1 
in a billion. 

It should be luued that the assumption of homogeneity of 
within-subject variance, Iiasic to the tests of significance sum- 
marizetl in Table fi, was entirely untenable at level 3, sentence 
completion, and was in doubt (P about .05) in the majority of 
the other eleven cases. I’he effect of lack of liomogeneity in 
parent populations is not completely understood; empirical 
studies indicate that moderate heterogeneity docs not cause in- 
tolerable divergence from theoretical F distributions. In the 
former case, liowever, it apjieared likely that the heterogeneity 
wa.s severe enough to introduce substantial error. 

•rite Independcttce of Moital Speed 

The fact that the log speed measures at the three levels of 
difficulty differentiated sharply between the individuals in the 
population specified l)y the thirty-six subjects having been es- 
tablished, the questions naturally arose (t) whether speed of 
response at the different levels in the four functions was con- 
stant, i.e., whether an individual’s speed at a particular level in 
a given function was indicative of his speed at other levels in 
the same or in different functions, and (a) whether there was 
significant relationship between speed and .altitude. 

The means of the observed log speed scores adjusted for ac- 
curacy provided unbiased cstimate.s of speed of response of the 
thirty-six subjects at three levels of difficulty in the four func- 
tions. (The means entered in the right hand column of illus- 
trative Table 5, for example, were the e.stimates baseil on the 
seven items at level i difficulty, arithmetic reasoning.) Being 
means of the resitluals from within item regression of speed on 
accuracy, they were free from item, level, and function effect; 
and their variation in a particular function was due only to 
differences between subjects and to differences within subjects 
from level to level. 
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For each subject, then, there were estimated true speed 
scores at each of the three levels of difficulty In each of the four 
functions. The question of whether speed was constant over 
the three levels was investigated, assuming homogeneity of re- 
sidual variance, by testing the null hypothesis that the differ- 
ences between subjects were zero In arithmetic reasoning the 
assumption of homogeneity of variance was in doubt (P = .05) ; 
in the other functions it was clearly acceptable. 

The results of the analysts of the variation of the scores, with 
allowances made for the loss in degrees of freedom resulting 
from the correction of the observed log speed scores for accu- 


TABLE 7 

Analysis oj y«iiatton nj EiUmated T'rue Speed Scales nt Three Leads oj 
Dtffciiliy in the Fan) Functions 
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racy, are shown in Table 7 The probabilities attaching to the 
variance or F' ratios in the right hand column were, by Kelley s 
transformation, all less than i in a billion, and the hypotheses 
that between subject differences were zero could be rejected 
with statistical certainty 

The question of whether speed was constant over the four 
functions at each of the three levels of difficulty was similarly 
investigated, the assumption of homogeneity of residual or 
wi thin-subject variance being tenable {P > .20) at each level 
The results of the analyses are shown in Table 8. The proba- 
bilities of obtaining the variance ratios in the right hand col- 
umn, if population differences were in fact zero, were all less 
than ,00004, 

When the speed estimates at the three levels in the four func- 



370 EDUCATIONAl. ANO PSYCHO I.OC;lC*AL MKAKURKMCNT 


tions were considered jointly, providing twelve estimates for 
each subject, the constancy of speed tliroughout all levels and 
functions could be examined. In that .situation, the ratio of 
between to wi thin-subject variance wa.s very great, with F = 
19.11. The supporting as.sumption of equal within-subject 
variance, however, was questionable, with P - .009. Thus 
considered, there prcdmbly were significant population difi^er- 
ences in variability as well as in mean speed. 

The intraclass coefificients of correlation, or fractions of the 
total variance of the true .speed estimates ascribable to between- 
•subject difference.s at the three levels of difficulty were .66 in 

•I'Am.!-; K 
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arithmetic reasoning, .Ho in number serie.s, .70 in sentence com- 
pletion, and .61 in spatial relations; while the coefficients for 
the estimates in the four functions were .32 at the first level of 
difficulty, .38 at the second, and .31 at the third. All of the 
coefficients were, of cour.se, highly significant — their signifi- 
cance having been established by the variance ratio tests — but 
the former four were substantially greater than the latter three 
It seemed probably, therefore, that there were both a general 
speed ability and a special speed ability linked to function op- 
erative in response. 

The fact that speed tended to be constant at the three levels 
of difficulty in all four functions suggested that, since it is known 
that speed in easy materials is independent of altitude, speed 
in harder materials might be indifferently related to altitude. 
The intraclass coefficients of correlation between the scores at 
the three levels, averaging about .70, however, indicated that 
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about 30 per cent of tlie speed variance was not predicted by 
the individual speed factor. It was possible that there was 
substantial covariation of speed with altitude at the upper 
levels of difficulty. 

In planning the study, it had been hoped to have twenty- 
four to thirty items of about 50 per cent difficulty in each test, 
half of which might be used in estimating speed and half, to- 
gether with the less and more difficult items, in estimating alti- 
tude. It developed, however, that none of the tests contained 
more than seventeen of such optimum items; and it was neces- 
sary either to decrease the reliability of the speed estimates or 
to measure altitude witli benefit of few 40 to 60 per cent items 
The latter course was judged the better. 

The frequency distribution of the cumulative accuracy scores 
on each of the four tests with the 40 to 60 per cent items deleted 
showed, as would be expected, marked bimodality. It was 
therefore necessary to employ a system of scaling the items on 
the basis of their difficulty so that an altitude score might be 
projected into the gap. Under the assumptions that the abili- 
ties measured by the tests were sufficiently normal in distri- 
bution to permit the use of sigma values as indexes of item 
difficulty, that any interval on the sigma scale might be divided 
equally between the items falling within the range of difficulty 
establishing the interval, and that the divisions of the scale were 
additive, a simple scaling scheme for scoring the items available 
for measuring altitude was devised. The scheme effected a 
marked reduction in the bimodality of the altitude scores. The 
reliabilities of the scaled altitude tests estimated from odd- 
even halves, without step-up, were 71 for arithmetic reasoning, 
.65 for number series, .75 for sentence completion, and .79 for 
spatial relations. The rank correlation coefficients between 
the altitude scores on the scaled tests and the cumulative accu- 
racy scores on the whole tests were all over go. 

The altitude scores of the subjects were the sums of the scaled 
values of the items they answered correctly. These scores, 
each multiplied by 100 and rounded to units, are shown in 
T able 9 The speed scores entered in the table were the rounded 
estimates of true speed at the third levels of difficulty. Thus, 
so far as the measuring instrument was concerned, the speed 
and altitude measures were independent. 
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The correlation of speed with altitude in arithmetic reasoning 
was -.070. in number series .008, in sentence completion 
-.025, and in spatial relations —.071. The coefficients were 
all less than one-half of their standard errors, and speed and 
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altitude in tlic four functions, as defined, were clearly inde- 
pendent in the population specified by the thirty-six subjects. 

Sumrvmy 

In this study two broad questions have been considered, (i) 
does speed of response to mental test items of varying degrees 
of difficulty, with accuracy effect controlled, differentiate be- 
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tween individuals, and (^.J is there a factor of mental speed in- 
dependent of altitude and independent of the function in which 
it is measured. 

Data were obtained by measuring the speed of response of 
thirty-six high-school sophomores and juniors to each of sixty- 
four arithmetic reasoning, sixty number series, sixty sentence 
completion, and sixty spatial relations test items of about 3 to 
90 per cent difficulty - difficulty being defined by percentages 
failing. The speed scores measured in seconds were converted 
to common logarithms, the conversion having the eflFect of de- 
creasing the heterogeneity of variances and of increasing nor- 
mality of the distributions sufficiently to permit use of precise 
tests of significance. 

When level of difficulty and accuracy effects were controlled, 
the null hypothesis that the mean speeds of response in the 
thirty-six sampled populations were ecpial was discredited with 
confidence approaching statistical certainty. The mean speeds 
were characterized by lelatively large errors, but the hypothesis 
was found no more acceptable when the maximum error vari- 
ance was taken into account. 

It was found, when accuracy effect was controlled, that the 
subjects who were fast in response to items at one level of diffi- 
culty tended to be fast at other levels, the individual effect 
upon the variation of the speed measures being highly signifi- 
cant (P < .ooooooocoi) in all four functions. Furthermore, 
the subjects who were fast in one function tended to be fast in 
the other three, the individual effect upon the variation of the 
measures in different functions, at each of three levels of diffi- 
culty, again being higlily significant (P < .00004). 

It also was found tliat the correlations between measures of 
speed, defined by mean speed of response independent of accu- 
racy to sixteen items of about 40 to 60 per cent difficulty, with 
independent measures of altitude in the same function were no 
better than chance, being —.070 in arithmetic reasoning, .008 
in number series, —.025 in sentence completion, and —.071 
in spatial relations. 

The intraclass correlations of the speed estimates, or the 
fractions of their total variance ascribable to individual effect, 
at three levels of difficulty were substantially higher than those 
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of speed estimates in the four functions. This fact meant that 
relative standings of tl\e subjects In speed were less affected by 
changes in difliculty in a function than by changes of function, 
It was concludeii, therefore, that in luldition to a general speed 
ability independent of altitude, the mental test items probably 
were eliciting a special ability in s[)ecd linked to the function 
in which it was belmt measured. 

Considerable evidence might have been marshalled in sup- 
port of the hypothesis that there were significant differences 
in variability as well as in mean sjieetl between Individuals 
in their responses to sets of homogeneous items. It is certain 
that there would have been highly significant differences had 
raw time measures been used The differences in variability 
of the log time measures were not, however, except in the harder 
sentence completion items of sufficient imagnitude to invalidate 
the statistical tests used. Tliat log speed of response, with 
accuracy effect controlled, discriminated sharply between indi- 
viduals in the poimlation specified by the sample and that there 
was an independent factor of speed operative throughout a wide 
range of difficulty appeared statistically certain. 
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A COMPARISON OI< FOUR MASCULINITY- 
FEMININITY SCALES 

JOSHPIl C HPbl'ON 
15cP.iuw University 

This brief paper is not an exhaustive study of the traits dif- 
ferentiating masculinity and femininity. Terman and Miles 
(lo) have provided the definitive report in this area. Our pre- 
sent study is primarily an empirical evaluation of- (a) the degree 
to which four different MF tests agree and (b) their respective 
capacities to distinguish, i.e, scpaiate into the anticipated 
dichotomy, between men and women. A third outcome of this 
analysis, arising from the necessary discussion of the tests them- 
selves, will be a useful summarization of some of the types of 
items demonstrating utility in characterizing sex differences. 

The four masculinity-femininity tests examined are the MF 
scales derived from each of the following; (a) Strong’s Voca- 
tional Interest Blank for Men^ Imnn M (9) ; (b) Kuder’s Pref- 
erence Fecorl, Form BM (6); Hathaway and McKinley's 
Minnesota Multiphasic Personality Inventory, Group Form (1 
and 3); and (d) Eleston’s DePauw Adjustment Inventory (4). 
The selection of these particular tests for MF analysis was 
largely fortuitous, i.e., the data for these specific tests were 
readily accessible from the records of counselees enrolled in the 
third annual Educational Guidance Clinic under the writer’s 
direction at DePauw University in June, 1947- This clinic, 
described elsewhere (5), provided the opportunity to collect the 
MF scores on these four scales under certain advantageous con- 
ditions. First, the tests were all taken within a span of two 
or three days, thus essentially eliminating the intervening lapse- 
of-time factor which often proves troublesome in comparison 
of such tests taken at different times and under differing condi- 
tions. Second, since the subjects were counselees who paid a 
fee to participate in an educational guidance opportunity, we 
can fairly assume the tests were approached under optimum 

375 
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conditions of sincerity, honesty, and general motivation This 
latter point is important because it has been demonstrated that 
MF scores are easily faked, if the subjects have been so re- 
quested (lo, page 77). 

The four MF’ tests tlnis available permit a particularly for- 
tunate chance to evaluate Mb' scales based on dissimilar cate- 
gories of items. Two of the tests, the Strong and the Kuder, 
are composed fundamentally of items measuring ififeresfs. The 
MMPI (used hereafter to denote the Minnesota Multiphasic) 
is composed of iterest items a)}d j)ersonality questions. The 
DePauw scale has items designed to elicit feelings and emotions 
of a more subjective nature, and thus shows similarity to the 
personality items of the MMPI. An obvious hyqiothesis, then, 
at the outset, is that the two inteiest tests should prove more 
closely related as one imir of Mb' scales The two so-called 
personality tests should foim another pair of agreeing MF scales, 
to the extent that personality questions enter into their item 
content. The determination of the extent of these correlations 
is thus one of our major objectives. Each of the MF scales is 
briefly described below to facilitate observation of similarities 
and diffeiences in item categorie.s. 

Description of the MF Scales 

’the Strong Scale. —Votm M of Strong’s blank for men coii' 
tains four hundred items; 304 of these items have been selected 
as discriminative between men and women, and are thus scored 
as the MF scale on this test. The scale used in this study was 
Strong’s sixth revision. In which the items are given weights 
ranging from +4 to —4. The scores used here are the sta 7 idard 
scores based on this sixth revision of the MF scale. The author 
provides norms (9) based on a total of 372 men and 372 women. 
Each sex group has approximately one- third high -school stu- 
dents, one-third college students, and one-third adults, The 
basic types of items have been summarized thus; 

(a) Items preferred by males: mechanical and scientific ac- 
tivities; physically strenuous and adventuresome activi- 
ties; legal, political, and army occupations; selling activities; 
and certain forms of entertainment (smokers, billiards, 
poker, etc.), 

(b) Items preferred by females: musical and artistic activities; 
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literary activities; kinds of people (largely unfortunate 
and disagieeablej, certain forms of entertainment (for- 
tune tellers, picnics, full dress affairs, entertaining, etc.); 
clerical work; teaching; social work; certain school sub- 
jects (.such as Bible, botany, etc.); and items relating to 
merchandise (such as looking at shop windows, buying, 
displaying, etc.) (9). 

Kuder Scale, -'rhe MF score for the Kuder Prejerence 
Record differs from the other three MF scales used in this study 
inasmuch as it is not based directly upon individual item differ- 
entiation. In determining the MF score on the Kuder test one 
first is obliged to score the test on the nine basic preference area 
scales. One then multiplies each of these nine area scores by 
specified weights, some positive and some negative, and de- 
termines the algebraic sum of the weighted scale scores. In 
this operation, masculinity is evidenced by high positive weights 
on three scales, namely Mechanical, Computational, and Per- 
suasive and by high negative weights on three scales, Artistic, 
Clerical, and Social Service. Masculinity is also indicated by 
smaller negative weights on the three remaining scales — Sci- 
entific, Literary, and Musical. Kuder, in his Manual (6), gives 
the computational procedure to determine MF scores for adults 
and also another set of weights to determine MF scores for 
high-school students. Thus far, no such scores have been de- 
veloped and published for college students. We therefore, in 
this study, used the computational procedures set up for adults 
and the scores used are the final values of the designated com- 
putational procedure divided by one hundred. For the adult 
group, Kuder provides norms for random groups of loi men and 
100 women. Pie also provides occupational group norms for 
certain specific male and female groups. 

MMPJ Scale — In the MMPI test, the MF scale is composed 
of 60 items from the total group of 550 questions. In neither 
manual (a or 3) is there any summary of the type of items thus 
utilized to differentiate between the sexes. The authors state 
some of the items were inspired by Terman and Miles and that 
others are original and that the items were originally selected by 
comparison of the two sexes. As the test is usually scored, a 
high standard score on the scale indicates deviation of the basic 
interest pattern in the direction of the opposite sex. In the 
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present study tlie score on MMPI is derived by subtrading the 
obtained raw score from the maximum possible raw score of 6o. 
This makes a high score here indicative of masculinity and a low 
score indicative of femininity, and keeps the anticipated correla- 
tions with our other three variables positive, because in the 
other tests high scores denote masculinity. 

The writer has made an analysis of the items in the MMPI 
MF scale and finds 17 of the 60 items concern themselves with 
likes and dislikes of an occupational or hobby nature. Thus, 
men like science, hunting, forest ranger, soldier, contractor and 
dislike librarian, florist, nurse, “drop-the-liandkerchief,” love 
stories, poetry, dramatics, etc. The other 33 items comprise 
the “personality reaction” portion of the scale and can be 
grouped somewhat as follows; 

(a) Twelve items expiessivc of emotional feelinijs (where tlie 
masculine amswer denotes less emotional feeling) ; thu.s 
the male indicate.s his feelings are not easily hui t, he doe.sn’t 
fear snake.s, he daydreams very little, family habits do 
not annoy him, and he feels he does not react more intensely 
than most people. 

(b) Another category of items concern leactions to people. 
This .set includes seven (picstions which indicate that the 
male in general has le.ss trust m people. A male i.s charac- 
terized by feeling that he .should if possible pay back 
wrong.s, that lie must .stand up for hi.s lights, that most 
people are honest only because they fear to be dishonest, 
most people make fiiend.s because friends are useful, that 
it pays to know who to get next to, etc. 

(c) Another category of five items is composed basically of 
those indicative of sexual inversion, sucli as too much in- 
terest in own sex and too much preoccupation with sexual 
problems in general 

(d) The nine remaining items aie of a miscellaneous natuie, 
difficult to group under any significant heading. 

'ihe DePauw Scale . — The DePauv) Adjiistmeiit Inventory, 
which is thus far experimental and has not been leleased for 
general use, is composed of three hundred “personality” items 
and has been developed to score on six basic scales in addition 
to the MF scale. The six basic scales liave been derived by 
item validation and no item scores on more than one scale. The 
MF scale, however, cuts across all the other six, and the items 
constituting it have been selected on the basis of their power to 



rOUR MASCULINITY-FEMININITY SCALES 


379 


differentiate between men’s and women’s answers. The popula- 
tion upon which the MF scale was originally constructed was 
composed upon two hundred men and two hundred women, all 
college freshmen at DePauw University.' Seventy MF items 
have been thus selectetl, composed of categories described as 
follows ; 

(a) Sixteen items reveal the male to possess more emotional 
stability; i e., he recovers more easily after being emo- 
tionally upset, his feelings are not as easily hurt, he is not 
easily startled, his mood is less influenced by others, and 
in general considers himself less emotional than others. 

(b) Eleven items indicate him to be more typically of the 
thinking introvert type; for example, he enjoys di awing 
conclusion.s from data, will question others’ views and opin- 
nions, meditates about things in general considerably, 
thinks befoie action, does not take Ins work casually, 
enjoys “brain-teasers,” and considers himself philosophi- 
cally inclined. 

(c) Eleven items show the male has moie confidence in him- 
self; thus, it IS not as hard for him to make decisions, he 
IS quick and sure in his actions, he feels he can accomplish 
his goals, he plays his best against superior opponents, and 
does not wish his appearance were different than it is. 

(d) Eight items leveal that he is .socially extroverted; he chats 
with clerks, lie does not like evenings alone, he talks to 
strangers when traveling, he rike.s to speak in public, and 
has a leady answer when otlicis make remarks to him. 

(e) Six items indicate the masculine trait of being more im- 
partial and objective; he does not feel that otlier people 
are usually against him, people are not so bossy that he 
wants to be contrai y, others do not offend him unwittingly, 
etc. 

(0 Seven items involve home adjustment; three show the male 
to be better adjusted and four show the female better ad- 
justed 

(g) The remaining eleven items are miscellaneous and difficult 
to place in any one descriptive category. 

'T’/ie Experimental Sample 

The population available for this study is composed of all the 
enrollees in the 1947 Educational Guidance Clinic at DePauw 
University for whom scores on all four MF scales were available. 
Out of approximately ninety students enrolled in the clinic, we 

'Miss Isabelle League carried out thi.s Ml* item-validation research under the 
writer’s direction. 
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had complete MF data available on thirty- four men and forty- 
five women. Mo-St of the.se were 1947 high-school graduates 
coming to the clinic to secure educational guidance for their 
college freshman year. One or two of the men had military 
service experience intervening between high-.school graduation 
and enrollment in the guidance clinic, 'rhe men range in age 
from sixteen to twenty-two, with a mean age of 18.3 years and 
an S.D. of 1.35 years. Tlic women form a more homogeneous 
age group, ranging from sixteen to nineteen, with a mean of 
17.9 years and an S D. of .68 years. 'I'lic group represents a 
fairly adequate sample of prospective college students interested 
in the various professions and in general liberal arts training. 

The ability level of the entire group is considerably higher 
than average. On the A .C.K. Psychological Kxarnhialion their 
median score is equivalent to the 7rst percentile on the national 
noims. The Cooperative English ‘Pest reveals about the same 
degree of superiority, and the three Cooperative General Achieve- 
ment Tests average slightly better than the 70th percentile for 
the group’s mean score. We can generalize by describing the 
group as composed of students of better-than-average scholastic 
ability, but typical in most other resjiccts of usual college 
freshmen. 

It should be added that nowhere during the clinic program 
was any reference made to the fact that any of the tests which 
were given could be scored on an MF scale. Hence, we can 
assume the students w'ere completely naive in this particular 
respect which, coupled with their generally excellent motivation 
in clinic participation, enhances the value of the data presented 
here. 


The Experimental Data 

In Table i we present the mean score and standard deviation 
for each of the MF scales, both for the experimental group from 
the clinic and the original groups providing the basis for the 
authors’ norms. The experimental group of women corre- 
sponds fairly closely to the expected means and S.D.’s of the 
original norm groups. However, the experimental group of 
men, supposedly more or less a random sample, are consistently 
lower in MF score on all of the tests except the DePauw Ad- 
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justment Inventory than the original norm groups. Two factors 
might be suspected here. First, it is only the DePauw Adjust- 
ment Inventory norms that are based on a similar group of young 
college men. Strong’s noims are based on high-school, college, 
and adult men combined; Kuder’s norms are for adult employed 
men; and the MMPI norms are based on a group of engineers 
and unselected non-commissioneil army men. 

The other possible causal factor here is tliat we do not have a 
random sample of men, at least as far as occupational interests 
are concerned. A quick summary of the two or three high 
“group” areas exhibited by each of these men on the Strong 
test confirms this suspicion. Sixty-five per cent of these high 


TABLK 1 

Mean and S D. of Each ME Scale Jorihe Experunentat Group Compated with 
etiilhor’s Norm 


MF Stale 

Group 

N 

Men 

Mean 

S.D. 

N 

Women 

Meao 

S.D. 

Stronif 

Kxp. 

34 

43.1 

11.3 

45 

27.8 

7.7 

Author 

.172 

so 0 

10 0 

372 

27.9 

7,9 

Kuder 

L'xp 

U 

64 2 

29.3 

45 

21.9 

25 4 


Author 

101 

80. y 

26 8 

100 

18.9 

24.9 

MMPI 

Exp. 

34 

33.4 

4 8 

45 

23.1 

4.5 


Authoi 

117 

39.5 

S 0 

108 

23.5 

5 0 

DePauw 

E'.xp. 

34 

45.2 

5.0 

45 

35.0 

7.6 


Author 

200 

42,4 

6.4 

200 

33.4 

7.2 


group scores are in Groups I, V, IX, and X of the Strong scale. 
It is precisely these groups, according to Stiong’s data (9) that 
exhibit negative correlations with the MF scale, ranging from 
approximately —.12 for Group I, to —.60 for Group X. It 
is easy to see, then, why this sample of men from the clinic, with 
interests concentrated in these four areas, would score lower 
than the expected norm on the Strong MF scale. The same 
explanation may hold for the Kuder test as well. 

In Table 2 we have attempted to demonstrate the effective- 
ness with which each MF scale can dichotomize the experimen- 
tal group into the two sexes. We recognize that the biological 
condition of being born male or female does not correlate per- 
fectly with the possession of masculine or feminine interests. 
Nevertheless, it seems logical than an MF scale, built upon an 
item-analysis designed to select items differentiating between 
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males and females, should be fairly satisfactory in segregating 
the two sexes according to MF score. Accordingly, we have 
assumed, since in our present data masculinity is indicated by- 
high scores, that the men should fall above the tlieoretical group 
mean (for the combined sexes) and that the woman sliould fall 
below that mean. Consequently, in Table a we have first com- 
puted the probable mean for the expciimental group if the two 
sexes had been equidly represented. I'hen, we have indicated 
the per cent of men on each scale that are above that theoretical 
mean, and the per cent of women that fall below. The average 
of these two can then be taken as an index as to how satisfac- 
torily each MF scale separates the two groups according to sex. 
It is apparent that all of the scales do a fairly adequate job in 
this regard, three of them being about 78 per cent satisfactoiy 

taulk 2 

Capacity oj Each MF UcaU to Dtehutomm the Experimental Graiip AccorJing to Sex 


Mr sralc 

Thraretital 
Urnuii Mean 

Men 

.\bo\T Mean 

‘'0 W'nmcn 
Hclo« Mean 

Average % 
vSRitaittctory" 

Strong 

.L‘;.45 

76.5 

80.0 

78. 3 "' 

Kudor 

•M.0.S 

76.5 

77 8 

77.2 

MMPI 

28.2,'; 

K5 3 

.81 4 

84 y 

OoPttiiw 

4(1. in 

«a.2 

71.1 

V) 7 


and the MMFI approximately 85 per cent satisfactory, making 
the latter the most effective in this respect. 

The ability of each of the MF scales to distinguish between 
male and female subjects can be estimated by another approach, 
i.e,, correlation. The standard biserial coefficient of correla- 
tion cannot be properly used in this connection because the 
customary biserial r assumes that even the dicliotomous dis- 
tribution does have a normal probability of distribution. 
Richardson and Stalnaker (7) have, however, suggested a for- 
mula for use in cases where there is no reason to logically assume 
normality of the dichotomized attribute. This formula produce 
what they call the point-biserial r. Applying their formula to 
the present data, we find the following point-biserial r’s between 
MF scores and sex: 


Strong .6^7 

Kuder .610 

MMPI .743 

DePauw .597 



FOUR MASCULINITY-FEMININITY SCALES 


383 


In each case we see a sizable positive correlation, thus demon- 
strating the ability of the scales in general to correlate with the 
respective sexes. Again, three of the scales (Strong, Kuder, 
and DePauw) exhibit approximately the same degree of effec- 
tiveness, with the MMPI demonstrating a somewhat higher 
degree of ability to separate the sexes. 

A third method of evaluating the success with which each MF 
scale can differentiate between male and female is the use of 
what Peatman (8) has termed the T Ratio. This T Ratio, used 
here as synonomous with the older term. Critical Ratio, can be 
used as a test of significance for the difference between any two 
statistics. Plere we have applied it to testing the significance 

TABLE 3 

"T" Rahos of the Differttict litlwten Sex Means for Data from Table /. 


Strong 

6.80 

33.45 

Kuder 

6.71 

17.39 

MMPI 

y 7.S 

23.91 

DePauw 

6,90 

13 22 


of the difference between the means earned by the two sexes 
on each of the MF scales. In Table 3 we show the iT Ratio 
for the experimental group for the sex difference in means on 
each scale In the parallel column are shown the corresponding 
T Ratios for each test as calculated by the writer from the 
authors’ norm data shown in Table l. The T Ratio for the 
experimental group is definitely significant for each of the MF 
scales, using the standard interpretation that a ratio of 3.00 
is necessary to safely reject the hypothesis that the difference 
between the group means might be due to chance alone It is 
obvious that factors other than chance have operated to pro- 
duce the difference between the sex means in each case. It is 
again apparent that on the basis of the T Ratio exhibited, the 
MMPI is somewhat superior to the other three tests in ability 
to discriminate between men and women and the three others 
are again approximately equivalent to each other in this ca- 
pacity. 

The smaller ratios demonstrated for the experimental group 
than for the original authors’ normative data may be explained 
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as due to two factors. First, we have already observed that 
our males in the experimental group were less masculine in their 
interest than one would anticipate on the basis of the authors’ 
norms Secondly, the experimental group is small, and as one 
increases N in a sample for computation of the 7 “ Rado, this 
automatically increases the T Ratio, a.ssuming the mean and 
sigmas remain constant. Thus if there had been one hundred 
men and one hundred women in the experimental group, ex- 
hibiting the same means and sigmas, the ratio would be raised 
to 15.6. 

As indicated earlier in the description of these four MF scales, 
it is apparent that they approach the problem of measuring 

TABI.K 4 

hUcrctrrthlwits Jmnng the Four hfF Scales 
(iased on nien and ,/? xenmen) 
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M 
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(.i) Strnno; 

— 

.'72(i 


,•118 

(bi Kuder 

.72(1 


(>77 

414 

W MMI’I 

.fiSfi 

()T7 

... 

.,s.w 

(d) DoPauw 

418 

414 

,S10 

•— 


masculinity-femininity from more than one angle. ThcKuder 
and the Strong approach it definitely from the standpoint of 
interests and hobbies. The MMPf combine.s twenty-seven 
interest items with thirty-three personality items in its MF 
scale, and the DePauw scale is composed entirely of personality 
items. One wonders, then, how much agreement may be se- 
cured between MF measurements based on these different 
scales. In Table 4 we have answered this question by present- 
ing the intercorrelatioiis among all four of the MF variables.’ 
The Strong and the Kuder show the highest correlation, as one 
would anticipate. The MMPI correlates almost as highly with 
the Strong or the Kudei , The DePauw is associated positively, 
but to a lesser extent, with both the Strong and the Kuder. 
The MMPI and the DePauw, having a common element of 
personality type items, correlate somewhat higher. The co- 
efficients in Table 4 have not been corrected for attenuation 


® Mn Robert Brjvdy contributed much of the correWiilonnl anulysis in n research 
course for the author. 
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because tlie reliabilities of the Kuder and MMPI scales are not 
available. 

As a further correlational consideration, it would be interest- 
ing to determine the effect if the MMPI scale were shortened 
so that the interest items were eliminated. We have therefore 
constructed a revised MF scale from the MMPI test composed 
exclusively of the thirty-three items that are not based on in- 
terests and hobbies. This abbreviated “personality MF scale” 
from the MMPI correlates with the DePauw .655, justifying 
the hypothesis that the personality items from the two scales 
are measuring more of the same thing than was apparent in the 
original correlation of 540 Further support for this approach 
to the problem is shown when one correlates this same ab- 
breviated MMPI scale with the Strong MF scale. The initial 
correlation of 686 between MMPI and Strong now drops to 
.389, if one eliminates the interest items from the MMPI and 
uses only the personality items. Thi.s coefHcient of 389 is very 
similar to the .418 exhibited between the DePauw and the 
Strong and the .414 between the DePauw and the Kuder. 
Thus a con elation of around .40 between MF scales based on 
these different types of items is apparently about what one 
should expect. Interesting support for this hypothesis is se- 
cured from Terman and Miles (loj, for they report that the 
average correlation between any one of the seven parts of their 
test and the other six parts is .39. They also report their Part 
4, which is made up of personality items (comprising anger, fear, 
disgust, pit)’-, and wickedness) has an average correlation with 
the other six sub-tests separately of .39. Another scale which 
might be used to demonstrate the relationship between MF 
scales based on personality items is the “M” scale from Guilford 
and Martin’s GAMIN hwentory (i). There are fifty-two items 
m their scale, with thirty-nine of them based upon emotional 
and personality reactions such as fears, annoyances, degree of 
confidence, etc. One can assume this MF scale would correlate 
rather highly with both the DePauw and the MMPI scale 
(minus the interest items). 

Conclusions 

Before we summarize this study into its major conclusions, 
one must bear in mind two limitations ; (a) the relatively small 
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size of our experimental group, and (b) the apparently somewhat 
biased occupational interest distribution of our males, who con- 
sequently scored lower on MF than one would expect on all the 
tests except the DePauw. Now, under these limitations, one 
can conclude the following: 

I. These four MF scales are about 80 per cent satisfactory m 
their capacity to place men above the mean score and 
women lielow the mean score. The MMPI is more ef- 
fective than the other three in this respect. 

1. The point-biserial r computed between each of these MF 
scales and the dichotomous category, men and women, in 
three of the cases is equivalent to approximately ,60. The 
other test, MMPI, shows a higher point-biserial r of .74, 
thus is once again slightly superior 

3. Using T Ratio as a test of significance of the difference 
exhibited between mean scores earned by each sex, we find 
all four MF scales demonstrate the difference definitely 
due to something otlier than chance factors, The three 
tests Strong, Kuder, and DePauw show ratios of approxi- 
mately 6.8 and again the MMPI is somewhat higher m this 
capacity with a ratio of 9.7. 

4. In terms of intercorrelation, the two MF scales based on 
exclusively interest- type items show the highest associa- 
tion, + .73. The DePauw, based on personality items, 
shows the least correlation with the other three variables. 
The MMPI, being composed partially of interest and par- 
tially of personality items, correlates with the other scales 
to the extent to which such items are present in the other 
scales. 

5. The MF measurements produced by scales based on dis- 
similar types of Items may be expected to agree approxi- 
mately in the neighborhood of -b.40. 
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an evaluation of five factors for predic- 
ting THE SUCCESS OF STUDENTS ENTERING 
THE NEW YORK STATE COLLEGE OF AGRICUL- 
TURE 


J P. IIERTKI, and FRANCIS J DiVESTA 
Cornell Uni versify 

As in many other colleges the counseling staff of the New 
York State College of Agriculture at Cornell University felt 
the need for measures which would supplement high-school 
averages in the prediction of college grades. On the basis 
of previous studies^ of agricultural students, the 01 m State 
Psychological ^cst, the Cooperative Natural Science 'Pest and 
the Cooperative Mat/iauatics Pest were selected and admin- 
istered to all entering students, starting in 1942.2 The results 
of a practical farm expciicnce test which is required of all 
entering students wci c also available for study. 

The group studied was composed of 324 male students 
enrolled as fieshmen in the degree com sc between 1942 and 
1946. These were students who had taken the three tests 
specified, as well as tlte New York State Regents examinations 
from which their high-school average wa.s calculated. Students 
who substituted agricultural courses for certain required 
courses, such as English, in their freshman schedule during 
the war years were not included. 

In order to study gioups of students taking similar courses 
in their first semester, the total group was divided into the 
following curricula: preveterinary, agricultural science, and 
general agricultuic. A comparison of the groups is shown 
in Table i. 

During the period studied 80 per cent of the freshmen 

'■ '‘Stiidie.s in Predittinn Sdiolastic Achievement,” Univetbity of Minne.sotn, 
1941; and nninthlislied stiidies in the College of Agriculture at the Univer.sity of Min- 
nesoui, by I, H, Harden. 

“The te.sfs were ndrnini'-tcrcd and the computations in this study were made hv 
the Coinell Univerd ty Testing Service. 
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selected for the degree course ranked in tire upper two-fifths 
of their high-school classes. 

For purposes of analysis the first-term average was used as 
tlie criterion. Actual scores were used for each of the predic- 
tive measures. The rcgrcs.sion equation was selected as the 
most suitable technique for determining the contribution of 
each factor toward the prediction of the college average. 

The procedure^' entailed the computation of fifteen inter- 
correlations, twelve second-order partial correlations, six 
third-order partial conelations, one fourth-order partial 
correlation, five partial-standard deviations and five regression 


TABI.K I 

Companion (^Freshmen Fo/lowhig Thte Typrs of Cumcula as SfowH 
hy the Mean and Standard lieshilion of .ill Factors Studied 


College Aver- 
age 

Coop, Math. 
Test 

Coop, Sci. 'I'cst 

Ohio .St. Psrch 

High School 
Av. 

h'arm Exper- 
ience 

Number in 
group 


Tyi* «l Curriculum l ollowcil 

Prcvctcrinxry Axr.Siicncc (Icn Air. Tolnl 

Mean Sul Dev Mean Sul. Dev. Mean Sul Dev. Mean Std Dev, 


74. 33 

fi. 19 

74.87 

t> 80 

7.1 73 

1 ) . 67 

74.22 

6,56 

8a It 

II. 4.1 

83.08 

1 1 60 

82 08 

12 14 

82.37 

11.80 

57 m 
77- *3 
8a. ay 

13.68 
at. 41 
4.72 

Ol .68 
90 75 
84 48 

I4.01 

aa.pfi 

5.3* 

58 ..16 

Ha. 14 
83 22 

I a f)8 

24- 1,1 
5.22 

5 y.ii; 

83.19 

8.1 31 

'3.43 

23.43 

5 ly 

aa.51 

14.41 

11.71 

13 - 0.1 

22.75 

<4 1.1 

19.86 

14 62 


90 9 t 14:) 3*4 


coefficients for each group and the total. The next step 
involved the utilisation of the above data in the determination 
of the final regression equation and multiple correlation for 
each group and the total. It was assumed that linear cor- 
relation existed between all factors involved. This assumption 
was based on scatter diagrams made in previous studies. 
All calculations were made by machine. Original calculations 
were carried to four decimal places. 

As shown in previous studies^ the results presented here 
indicate that high-school grades are more prognostic of college 

“ Garrett, Henry E. Statistics in Psyeholoty and Education, New York; Long- 
mans, Green and Co., 1946. 

^Segel, David. Prediction of Success in College (Bulletin No. H). Washington, 
iJ, C.; U. S. Office of Education, I934. 
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scholarship than, general mental tests or specific subject- 
matter tests. The highest association was found between 
the high-school average and college average, the correlation 
being .525 for tlie group as a whole (Table 2). When the 
groups were studied separately, a significant deviation was 
noted in the agricultural science group where the correlation 
is ,398 as compared with .605 for the general agricultural 
group. 


TABLE a 

Tht Inter-Relalionshipi between First Term College Aoerages, Cooperalr - Mathematics 
Test Scores, Coaperatioe Natural Science Test Scores, Ohio Stale Psychological Test 
Scores, Nigh- School Aoerages and Farm Experience of Freshmen as Shown by Correlation 
Coefficients 



Prftvetcn- 

Tyw of Curriculum Followed 

Aar. 



nary 

Science 

Gen. Agr 

Total 

College Average and 

Coop. Math. 'lest 

.18S 

133 

•194 

.351 

Coop. Nat Sci. 'I'c.st 

• 3 ’i 9 

.159 

.361 

.331 

Ohio St, Psych. Test 

•398 

.478 

.460 

•447 

High-School Average 

■ 538 

•398 

.605 

■SIS 

Farm Experience 

- 103 

— 058 

-.029 

- .049 

Coop. Math lest and 

Coop. Nat Sci. le.st 

1.19 

172 

212 

.183 

Ohio St Psych Test 

.164 

364 

• 294 

.281 

High-School Average 

•V 3 

275 

349 

.310 

Farm Expeiiencc 

. 104 

OSS 

— . I7I 

- 045 

Coop. Nat. oci. lest and 

Ohio St. Ksveh. ’lest 

•494 

•444 

.456 

471 

High-Scliool Average 

297 

■193 

•474 

.381 

Farm Experience 

•037 

-.359 

.188 

— ,017 

Ohio St. Psych, lest and 

High-School Average 

•344 

•SS') 

• 5 .i 6 

• 513 

Farm Experience 

— .too 

— .021 

-.181 

— .172 

High-School Average and 

Farm Experience 

— .205 

— 066 

.038 

- 095 


Included in the high-school average there are relatively 
few science grades. The freshmen following the various 
curricula in agricultural science took a much higher proportion 
of college science courses than the other groups studied 
Hence the high-school average was not as good a predictive 
factor for the agricultural science group. This is brought 
out more forcibly in Table 3 when the influence of other 
factors studied was held constant. 

The inter-correlations show that the high-school average 
was associated most highly with the Ohio State Psychological 
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’Test {r — ,513) and least with the Cooperative Natural Science 
Test {r — .3fii) and the Cooperative Mathematics Test (r = 
.310). There was practically no association with farm experi- 
ence except in the prcveterinary group where there was a 
slight negative correlation of —.2.05. This may be explained 
by the fact that among students with little farm experience, 
only those with ve,ry good high-school averages are selected 
for the preveterinary course. 

The second best predictive factor was the Ohio State Psy- 
chological Test which correlated .447 with the criterion for 
the whole group. The intercorrelation with the high-school 

TABI.K a 

The Relationship IleHceen College Jterage ami liaeh Predictiee Factor Stiulicil 
IVhen The Infiuence of The Rtmoiniiig Facinis Is Held Constant 
as Shown bj I'mlial Can elation Coefficients 


HfiLtlinR remaining 
(a( Uirnconi^uinl 

I'revrleri- 

nary 

Tyix' of ('iirnrulum rullownl 
Agr 

Kticnic CJrn A^r 

Toinl 

Collide Avernge Co CcKip. Mciih 
Test 

.C 47 

.0/(1 

oyo 

• 07 J 

Collt'(ie Avenige to Conp. N.it Sc'i 
Test 

0<;S 

030 

■' .OlO 

002 

College .‘Average to Clhiu St. I'sycli. 
'I'est 

:cv 

187 

.197 

.208 

College Aver.ige to High Sthool 
Average 

• 440 

• '72 

• 44S 

.853 

College Average to F.crm F.xiicr 
ience 

■■■044 

.05H 

-.047 

.017 


average was .344 in the preveterinary group compared to 
.559 in agricultural science and .536 in the general agricultural 
group. This may be a result of the homogeneity of the 
preveterinary students due to more rigorous selection 

Of the two tests designed to measure specific subject matter 
the Cooperative Natural Science Test correlated more highly 
with the college average (r -- .321) than did the Cooperative 
Mathematics Test'ir = .251). The correlation between these 
two tests was relatively low--- (r =- . 1 83) . 

When each predictive factor was studied with the influence 
of all other factors held constant, only the high-school average 
and the Ohio State Psychological Test proved to be of any real 
importance (Table 3). The fourth order partial correlation 
of the college average to hlgh-school average was .353 and to 
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thtphio State Psychological t est .208 for all groups combined 
The Cooperative Mathematics Test and the Cooperative Natural 
Science Test were so highly associated with the Ohio Psycholog- 
ical Test and with the high-school average that their separate 
influence was negligible in predicting the first-term college 
average of these students. 

The authors were surprised to find the relatively low asso- 
ciation between the college average and the Cooperative Natural 
Science Test as evidenced by the zero order correlation (.259) 
and the fourth order partial correlation (.030) for the agri- 
cultural science group The test did not appear to predict 


TABLE 4 

Rtlation of Aotwl Fmt Tom College Average of Freshmen Following One of the CwncuU 
III Genera! Agriciilliiie to Aveiage as Piedtcled by High-Rchool Average, Ohm 
State Psychological Test and Cooperative Mathematics Test Scoies 


I’rediclctl Av croKC* 


Actual Aviiragc 

* 
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0 
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0 
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2 
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I') 

0 

0 

s 

10 

1 

Below fK 

0 



— 

V - 

— 

Total 

>41 

I 


77 

37 

3 


* Formula-- Predicted averaRc ” {Coop. M.uli. tc.st. score X 04) + 

fCoop. Sci. test score X.oo) + 

(Ohio State Test score X 05) -|- 
(High School .average X.6;j) -t- I4.91 


scholastic achievement in college science courses for these 
students. 

For all practical purposes it appears from Table 3 that the 
preveterinary grouji might have been combined with the 
general agricultural group. Those students following the 
more specialized curricula classified as agricultural science 
demand specialized attention when an attempt is made to 
predict their college average 

On the basis of the data mentionedj regression equations 
were developed for each of the specialized curricula. The 
multiple correlations were .55, .51, and .64 for the preveterinary, 
agricultural science, and general agriculture groups respec- 
tively. A multiple correlation of .57 was obtained for all 



394 EDUCATIONAL AND PSYCHOLOGICAL MEASURDMi: NT 


groups combined, A comparison of the actual and predicted 
scores of the general agricultural group is shown in Table 4. 

Fifty-three per cent of the students who were predicted 
to make averages between 60-69, 59 of those predicted 

between 70 79 and 54 per cent of those predicted between 
80-89 actually fell in these groups. 

Confronted with the problem of admitting students on the 
basis of the predictive factors studied here, an admissions 
officer in a college of agriculture would find it difficult to admit 
only those students who would make a 70 average or liigher. 

Although the multiple correlation of .64 appears statistically 
and graphically satisfactory, it still has serious limitations 
when put to practical use. 

The difficulty of predicting college achievement increases 
with the amount of selection wliich has taken place in the 
admission of the students studied, In a group of college 
students selected because of their good high-school grades 
most of the causes of failure arc probably factors which are 
not measured by existing tests. 

Superficially, poor health, lack of self-discipline, inability 
to organize time and materials, too many extra-curricular 
activities and too much outside work appear to cause failures. 
On the other hand, most counselors h.ive observed students 
who have succeeded in spite of similar handicaps. This 
difference might be accounted for if we were able to measure 
the factor commonly called drive or motivation. 

A science test which would have a high correlation with 
college science grades and a relatively low correlation with the 
Ohio State Psychological ’Pest would also contribute to an im- 
provement in present predictive possibilities for students in 
the College of .Agriculture. 

Sumvuiry 

These data support previous findings that the high-school 
average is the most important .single factor in the prediction 
of the college average. The most important test of the battery 
used for prediction was found to be the Ohio State Psychological 
Pest. The Cooperative Mathematics Pest and the Cooperative 
Natural Science Pest were negligible factors since they were 
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Statistically dependent upon factors already accounted for by 
the Ohio State Psychological 'Test and the high-school average. 
Although preliminary studies showed that farm-reared boys 
were more successful than those who entered with no farm 
experience, the farm experience rating used in this study showed 
no significant association with the first-term average. 

The highest multiple correlation of .64, although significant 
statistically, was found to be of limited value in predicting 
the success or failure of individual students. 

Future studies attempting to predict college averages 
should include a better measure of aptitude for college science, 
a measure of motivation and in general, measures which 
correlate high with the criterion and low with each other. 




A MEANINGFUL RECORD OF TESTS 

I'DWARD C. ROEBER 
University of Missouri 

The recording of test scores on cumulative records and report 
forms is a tiresome occupation at best; nevertheless, the mate- 
rials so recorded become a permanent record. Frightful pre- 
dictions or evaluations are often based upon the symbols re- 
corded on such records, the tests themselves having long since 
been destroyed. The exact situation becomes more apparent 
to anyone privileged to examine schools’ cumulative record 
files. The writer has within the past few years discovered 
records which contained only the name of the test, the raw 
score, and the percentile rank. In some cases the name of the 
test was given as a meaningless abbreviation, viz., “Otis.” 
It is quite evident that Otis has published several tests and 
several forms of each test. Counseling upon the basis of 
such information would be extremely hazardous for the trained 
counselor, who would probably reject such data as incomplete, 
without placing it at the disposal of many teachers who are 
inadequately trained for interpreting standardized tests 

The cumulative record which adequately records essential 
test data must still be in the process of formulation since it has 
not appeared on the market. What might such a record con- 
tain if it were to meet the standards of “safe-and-sane” coun- 
seling? It would seem that the following bits of information 
were a prerequisite to the understanding and interpretation of 
test results from test records : 

I, Name of 'Test: The name should be as complete as neces- 
sary to distinguish it from all other tests. If it has been 
revised, this fact should be noted by the date of revision. 

2 Level and Form of Test; Tests which have various levels, 
usually expressed as alpha, intermediate, elementary, pri- 
mary, secondary, adult, etc., should have this fact re- 
corded. The same holds true for the form of the test 
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since, in spife of the comments of some test authors, there 
appear to he differences between the forms of the same 
tests. 

3. Raw Score: It i.s rather standard practice to record this 
information so no comment i.s ncce.ssary. 

4. Percentile Rank, Standard Score, 1“ -Score, Mental Age, etc.: 
Again this information is adequately recorded on most 
records. 

5. Norm-group or Basis of Comparison: A raw score is mean- 
ingless without com[Kuing it with the performance of some 
group. In the case of a few tests, the norm groups are not 
as appropriate as the situation demands. It is, therefore, 
essential that the norm group be recorded since a test score 
will assume its true meaning when its norm group has been 
identified. Furthermore, additional significance might be 
added to scores by recording tlic mean and standard devi- 
ation of performance for the norm group. 

6. Probable Error of Test or Parts of a Test: For years test 
authors have included probable errors of their tests in 
their test manuals. It would be interesting to discover 
how many teachers who interpret intelligence tests, for 
example, know the meaning of a probable error, Bing- 
ham* says, “When intcrj)reting a person’s performance, 
obtained scores should not be thought of a-S a point on the 
scale, but rather as a band or zone about that point; . . . ." 
If this is the case, the present methods of recording a score 
as a point rather than as a band has only encouraged 
teachers to accept test .scores as absolute. It is time that 
this practice he changed for the good of pupils. If neces- 
sary, the band should be recorded instead of a single score, 

7. Test Administrator: Chance errors in the administration 
of a test may widen the band of values which are repre- 
sented by a score, 'riicse errors may reside in the test 
administrator himself -thus the emphasis upon the in- 
clusion of tills information. Perhaps of equal importance 
would be some record of who scored the test and whether 
the test was re-scored to catch any errors, 

'Bingham, W. V. Aptitudes and Aptitude Testing. New York: Harper and 
Brothers, i937i PP' 2S3-1S4. 
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8 , Date of 'T cst Admhnstration- This item may be needed in 
checking the age or grade when the test was administered. 
It is, therefore, more of a convenience for the counselor. 

5 Unusual 'fest- Administration Conditions- This type of in- 
formation assumes high importance when checks are made 
as to why supposedly similar tests reveal sucli startling 
discrepancies. There is ample evidence to show that 
physical condition, home conditions, and other emotional 
factors, liave their effect upon any individual’s perform- 
mance. Furthermore, rapport between the test adminis- 
trator and those taking a test is essential for the best 
performances. Besides the individual himself there are 
physical conditions, such as heat, humidity, extraneous 
sounds, and other conditions in the testing room which will 
have their effect upon test performance. A test inter- 
pretation which ignores the individual’s condition and 
testing conditions is not valid — thus there is a need for re- 
cording this data, 

The relatively complete information, suggested above, may 
not meet with the approval of those who record test data. 
Teachers, though, with such information are apt to avoid ab- 
solute statements regarding test results. And, if such an at- 
titude were put into practice, it might avoid a possible reaction 
against all tests because of amateurish interpretations. Tests, 
assuming many imperfections, are better than chance. They 
are tools in much the same manner as chisels are the tools of 
carpenters. A chisel in the hands of an amateur is not the 
same tool in the hands of a master carpenter — and so it is with 
tests. Tests in the hands of an amateur can do much harm. 
In order to avoid an adverse attitude toward all tests and to 
avoid a recession to pre-war attitudes towards the testing move- 
ment, every precaution must be taken to avoid unscientific test 
interpretations. The proper reporting of test results is one step 
in that direction. 


Summary 

1. Present school records of test data are generally inade- 
quate, 

2. The following items are essential to adequate test report- 
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ing on cumuhitive or otlier records; (i) full name of test; (a) 
level and form of test; (3) raw score; (4) percentile rank, stand- 
ard score, T-score, etc.; (5) norm group or basis of comparison; 
( 6 ) probable error of test; (7) name of test administrator; ( 8 ) 
date of test administration; and (9) unusual te.st-administra- 
tion conditions. 

3. The testing movement may suffer another recession unless 
those who interpret tests are equipped with complete informa- 
tion on test records. 
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KDIT(JR’S FOREWORD 


The Proceedi?igs of the American College Personnel Associ- 
ation contain the principal papers presented at its annual 
meeting in Chicago, March a9-April i, 1948. Due to lack of 
space, no attempt was made to include the comments of dis- 
cussants and panel members on the program. The proceedings 
of the business meetings, a membership directory and the new 
constitution are lieing printed separately and will be distributed 
to the ACPA membership by the secretary of the Association. 

The ACPA and other constituent organizations of the 
Council of Guidance and Personnel Associations held their 
annual meetings concurrently. March 30 was set aside by all 
organizations for a joint “Council Day” program. Daniel D. 
Feder, Dean of Students, University of Denver, and President 
of the Council of Guidance and Personnel Associations, entitled 
his presidential addres.s “Next Steps m the Personnel Profes- 
sion,” Other principal Council Day speakers and the titles of 
their addresses were: Herold C. Hunt, General Superintendent 
of Schools, Chicago, Illinois, "Our Professional Horizons”; 
Ben M. Cherrington, Member of the United States Commission 
on UNESCO and Director of the Social Science Foundation, 
University of Denver, “The Role of the Counselor in World 
Peace and Organization”; Sally Butler, President, National 
Federation of Business and Profes.sional Women’s Clubs, Inc., 
“Jobs, Citizenship and World Understanding”; Leonard D. 
White, Chairman, Department of Political Science, University 
of Chicago, “l^rofcssional Attitudes among Public Personnel 
Workers”; and Corinne V. Loomis, Piesident, International 
Association of Altrusa Clubs, Inc., “Your Sixth Sense.” Due 
to limited space. Council Day presentations are not included 
in the ACPA Proceedings. 

The attendance at the 1948 Chicago Convention set a new 
record, which is somewhat indicative of the growth of profes- 
sional interest in .student personnel. The piogram emphasized 
Personnel IVork as a Profession^ and the contributions recorded 
here will be useful to those people engaged in or interested in 
all phases of college student personnel service and its adminis- 
tration. 


A. C. Van Dusen 
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Presidential Address 


nm GREATEST’ TRAGEDY IN COLLEGE 
PERSONNEL WORK 

C. GILBERT WRENN 

Professor of fUiucaiional Psjchology, [Tnivermtv of Minnesota 

It is not easy for me to be humorous in a manuscript. I tried 
humor on this group several years ago at St. Ixjuis. A parable 
was told about the characters Personnel, his mother, Mrs. 
Academic Work, a Doctor Statistic, and even Ferdinand the 
Bull was brought in. I tliought it was clever and humorous, 
but I was the only one who laughed! So I must perforce be 
serious and this year I thought I’d go the wliole way and be 
tragic. 

Before I put on my Hamlet robes, allow me to be a prologue 
reader and relate some of the cheerful things about develop- 
ments in college personnel work. T/ie assumption of responsi- 
bility for personnel Junctions is more widespread. Not everyone 
who talks about the need for student personnel work knows 
what he is asking for but the use of pcisonnel procedures in the 
military and in industry during the war has made the term 
respectable. It is less often confused in spelling with the word 
“personal." This sounds as though I were trying to be clever 
and a little cynical. Not so. There is dangei, of course, in a 
term being bandied about too long, and acquiring an over-load 
of meanings. There is marked advantage, on the other hand, 
in not having to define and defend the general significance of a 
function each time you introduce the subject. Compare your 
experiences of the past year in this connection with those of 
ten years ago. 

I could cheerfully spend some time on the subject of terms, 
but, then, 1 am not supposed to be cheerful tonight. I could 
tell you how I would gladly bury the word “guidance" entirely 
and use only the term, "personnel” with the appropriate adjec- 
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tive such as student personnel, industrial personnel, etc., in front 
of It. We could then speak in common terms with public 
schools and non-school agencies of "personnel functions,” 
“personnel administration,” "peisonnel research” and other 
concepts that are written into the Charter of this Association. 
I’d also relegate “counseling” to its appropiiate position as one 
of a number of personnel functions and not have it substituted 
in people’s thinking for the entire personnel program. 

’The demand for student personnel workers has been and is acute. 
This is a sign of growth and a cause for cheerfulness. At almost 
any one time during the past year I could have named ten or 
fifteen places where they were looking for an individual to fill 
some type of personnel job. Each of you who is training per- 
sonnel workers could testify similarly. This demand and the 
relationship of our association to it is being recognized in our 
proposed Directory Information Service. Such a demand has 
its serious dangers. The present supply of qualified people is 
not adequate. Furthermore, when trained workers are ap- 
pointed they are not always given responsibility commensurate 
with their qualifications as professional people. These dangers 
are too obvious to need analysis here, but they cannot be for- 
gotten. 

There has been progress in the technical tools and procedures 
made available to personnel people. Objective and projective 
appraisal tools, individual and group therapy procedures, occu- 
pational analysis, mental hygiene procedures in discipline and 
adjustment are illustrations of technical developments. There 
is less of an authoritarian, paternalistic flavor to our relation- 
ships with students and more emphasis upon individual initia- 
tive and responsibility. The housing and social environment 
of students is taken seriously with the college assuming more 
responsibility for environment. More could be said. There 
is healthy growth, even healthy friction. But where are we 
failing most seriously? Professional people may worry too 
much about themselves but where worry exists I have hope. 
I am far more afraid of complacency and crystallization. So 
let us worry a little about our field of work, xf/ what critical 
points should we examine the student personnel program in each 
institution? There are four such points, the last of which I 
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believe to be most pervasive and theicfnre the "greatest 
tragedy," 

I. Job and 'Tunning Stand aids 

'The first of three minor tragedies in the present day student per- 
sonnel field is the lack of commonly accepted standards of per- 
formance and of professional preparation. Had the Board of 
Representatives of the Covincil (of Guidance and Personnel 
Associations) not cho.sen as its theme "The Status of Personnel 
Work as a Profession," I woultl have taken this subject for my 
address to you. It is my personal belief that college personnel 
work is not a profession upon several counts, the chief of which 
is its immaturity in this matter of standards. Some of you 
were present at tlic University of Minne.sota ti^th Anniversary 
Institute last November when Dean Durley and I analyzed the 
status of student personnel work as a profession. Between us 
we applied eight criteria of professional status to this field. 
They were as follows : 

1. The application of standards ol selection and training 

а. The definition of job title.s and function.s 

'I'hc possession of a body of specialized knowledge and 
skills 

4. The development of a professional consciousness and of 
professional groups 

5. The self-imposition of standards of admission and per- 
formances 

б. The legal recognition of the vocation 

7. The development of a code of ethics 

8. The performance of a socially needed function 

We concluded that only in the possession of a body of spe- 
cialized knowledges and skills had we achieved reasonable 
maturity. In the other seven wc are merely on the way. By 
some criteria, such as job definitions and standards, and legal 
recognition, we are only a few inches from the starting post. 

Practically speaking, anyone who is persuasive and knows a 
sufficient number of the right people can be appointed to a 
personnel position on the campus. There are no well-accepted 
standards of preparation, academic or otherwise, no licensing, 
no requirement of internship or experience under supervision, 
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A good share of this indefiniteness exists because job definitions 
have not been crystalli2ed The administrator cannot hire a 
personnel worker with anything like the definiteness that he 
hires a stenographer or a professor of mechanical engineering. 
Part of this is our fault. We have failed to advise the adminis- 
trator what established people in the field consider job functions 
and adequate qualifications. One of the previously mentioned 
criteria of a profession is that of “the self-imposition of stand- 
ards of admission to the profession and of performance in it ” 

Independent of the report of our Standards Committee or of 
later action by the Association I would like to go on record 
with three recommendations. (These refer only to college and 
university student personnel work.) 

I. Job descriptions and specifications foi the several major 
student personnel functions must be established by the pro- 
fessional workers most concerned. We will meet with coopera- 
tion from general administrators in higher education theie if 
the approach is reasonable, but, meet it or not, those with both 
a vocational and an ethical stake in the field must take the step. 
If such clarification goes by default to the President or to the 
Faculty, or to the slow laborious march of time, we have no one 
but ourselves to blame. 

% Two years of graduate training with the equivalent of one 
year of full-time experience m college teaching or personnel 
work should be the minimum training and experience to qualify 
a person for any college personnel position except those which 
are definitely subordinate, routine technical, or clerical in 
nature. This will come. We should anticipate it. The most 
desirable training is basically psychological but it must include 
preparation in the field of higher education organization, cur- 
riculum, and philosophy, and preparation in the field of social 
organization and dynamics. 

3. Responsibility for the selection of people to be trained, 
selection in terms of personal qualities and intellectual ability, 
should be placed squarely upon the graduate school that gives 
the training. 

The condition of vagueness as to job qualifications and train- 
ing that now exists need not be a minor tragedy for long, but it 
certainly is so at present. 
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II. ImtiaHon and Direction of Program Jrom Above 

The .second jKsinf of \veakne,H.s on all too many campuses is 
that students and Jacnlty^ ■who have the most to gain from student 
personnel work, have the least to say about its development and 
emphasis . Faculty repre.scntation on administrative and policy 
committees is widespread but not complete. Two summers 
ago, in talking to the Imculty at the Dnivcr.sity of Colorado, I 
.said that three groups make uj) a campu.s community — the 
Administration and staff, the lAiculty, and the students; and 
that they should all be represented on policy committees. It 
was further .said that we had won the fight for faculty represen- 
tation on policy committees but that the student group was still 
shut out. After this lecture, a visiting faculty member from 
a large west coast university got up and stated publicly that 
they had not won the fight us yet at hi.s institution. There was 
no faculty senate or other legislative body in his institution (and, 
of course, no student representation.) On the other hand, the 
Student Affairs Committee of the Faculty Senate at one large 
university consists of six faculty members and administrators 
and .six students, Thi.s committee estahli.she.s policy for all 
student organizations and for all campms activities in which 
students play a major part. 1’his is a .step in the right direction, 
Other campuses have gone still further, I recall that, after 
having commented on this point at the National Conference 
on Higher Education at Chicago last April, a representative 
from Wilberforce University in Ohio spoke to me about his 
campus. He stated that there is student representation on 
every policy committee in his college, including the adminis- 
trative committee. Of cour.se, Antioch College has community 
representation par excellence and there are a number of similar 
situations, but the picture as a whole is not too bright. How 
is it on your campus? 

This is .so impoi'tant for the student personnel program be- 
cause student personnel services arc provided tb meet presumed 
student need. Who says the students want or need a given 
service? When policy is formulated or operation modified to 
better meet student need, who says that it will better conditions 
or that students will utilize the service? Most often it is an 
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administrator who lias to act. Sometimes a faculty committee 
will issue the pronunciamento. This is too limited and too 
subject to serious error. Students and faculty must be fully 
represented on personnel policy committees because fewer 
mistakes will be made than if decisions are made by the admin- 
istration alone. And this is no disparagement of honest, 
hard-working deans. It is a recognition of the fact that all 
three groups m tlie college community will see the same need 
or policy from different points of view. All are affected by the 
policy also. 

A second reason for student and faculty representation is the 
improved reception under these conditions of any change in 
policy or program. Every campus should examine itself on 
these two related points: Is there a student personnel policy 
and who made it? Mr. Hopkins clearly pointed up this same 
principle in his paper. Administrative machinery must be 
established that will insure faculty and student contribution to 
personnel and other policies. Of couise the machinery must 
be present to keep the policy fluid as conditions change or new 
knowledge becomes available. Beyond this there must be a 
clear understanding of the difference between policy making, 
a legislative function, and the execution of policy, an adminis- 
trative function. 

III. Coordination Through Appropriate Line and Staff 
Organitation 

This leads to the third critical point. loor coordination oj a 
student personnel program is frequently the result of an incom- 
pletely formulated line ajid staff organization . 

The organization of personnel work is like the organization 
of any other function within an agency or institution. That is, 
it is a matter of line and staff relationships. In this respect, it 
appears that some would like to avoid facing the question of 
centralization and direct line authority by talking rather glibly 
of the coordination of personnel work. I am not sure that this 
is an adequate Solution, It is true that coordination of what 
may be scattered and discrete personnel services must be 
effected. But this does not dispose of the fact that someone 
must b’e responsible for the total set of functions involved in a 
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personnel program. Coordination rather than administration 
has been proposed in an attempt to avoid offending or frighten- 
ing certain people. Tlicrc i.s always the {lossihility, however, 
that it may be ?tecessary to olrange functions or to make indi- 
viduals directly re.spon,sihle to someone other than the president, 
The individual who directs the progr.im of personnel services 
is mo.st commonly calleii a Dean of Students, although he may 
1)0 called Director of Student Personnel or a Vice President in 
Charge of Student Persrjimel. In any event, he has an admin- 
istrative responsibility parallel to that of the Dean of the 
College and the business manager or Cotnptroller. At the 
Xational Conference on Higlier Education previously men- 
tioned, there was a rather general agi cement upon three or 
possibly four major areas of ailministralion in colleges and 
universities: the administration of instructional functions, the 
admini .strati on of student personnel functions, and the admin- 
istration of the business funciioms. .Some would add a fourth, 
the administration of public rcl.itions. In any event, there 
was agreement that .student personnel functions were to be 
administered by a man responsible foi rite total program 
directly to the President, 't’hi.s is a line relarionsitij) from each 
service through the Dean to the Pre.sident. Vice President 
Hopkins would interpose an intermediate echelon; a vice presi- 
dent responsible for tltc administration and coordination of 
both instruction and personnel. lie is doing this at Wash- 
ington State College. 

The second problem, how'cvei , is that of staff relationships, 
Many functions such as that of counseling, are performed by 
individuals who themselves are not in a line relationship to the 
Dean of Students. They arc responsible to the business man- 
ager or to the Dean of the College. Here is where it becomes 
necessary to see that this function is properly carried out 
through a staff relationship established between the instructor, 
for example, and the Dean of Students. By agreement be- 
tween the Dean of the College and the Dean of Student Per- 
sonnel, the teaching staff member can be held responsible for 
the performance of a counseling function as a normal part of 
his teaching work or where he is acting as a faculty-counselor. 
Once it is clearly understood that he has only a staff relation- 
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ship to the Director of Personnel and a line relationship to the 
Dean of the College, much of any uncertainty as to responsi- 
bility is dissipated. The same is true, for example, of those 
who are responsible for the management of dormitories. The 
dormitory director may be under the Comptroller of the insti- 
tution for the strictly business management of the dormitory, 
but responsible to the Dean of Students for the social and coun- 
seling program. He has a line relationship to one and a staff 
relationship to the other and someone must clarify which is 
which if friction and lowered efficiency are not to result. It 
might be better still in the larger dormitories to maintain a 
strict line relationship with a business manager responsible to 
the comptroller and a director of a program responsible for that 
function to tlie Dean of Students. Both arrangements would 
be by agreement between the Dean of Students and the Comp- 
troller who have a staff relationship to each other. 

During the past two years I have spoken or acted as personnel 
consultant on twenty-six college and university campuses from 
Massachusetts and Virginia to California and Washington, and 
this question of coordination through appropriate organization 
has been the most constant major problem Institutions like 
the University of Denver, the University of Colorado, and 
Washington State College have taken great strides toward the 
establishment of a completely coordinated program. This is 
a coordination based upon a formulation of policy and careful 
planning of line and staff organization that has extended over 
many months or even years. (It is probably unfair to name 
any institutions in this connection. These are given because 
their work is fairly recent.) The line and staff problem is acute 
because efficiency and results are so vitally affected by good or 
poor organization of existing services. And the day is coming 
when a personnel program will be judged by its results, not by 
paper organization or the indorsements of those in high places. 

IV. Isolation from Significant Influences in the Life of the 

Student 

What has been said thus far is not too new. What I want 
to say now is less well formulated and harder to express. Please 
allow m,e to blunder ahead and state it this way: A student per- 
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i on n el program on a cnmpHs lends to he isolated from four impor- 
tant influences in the lift of the student, la) the home, {b) secondary 
schools, (c) the crdlegc classroom, and (d) the spiritual resources of 
the campus. 

The Home, I rccoj:ni/c that tlic stiuicnt of college age is in 
the process of emancipating himself from tlepcndencc upon 
parents anti the home. In spite of tiiat fact tlie home is the 
most single imptn-iant clue to what has happened to him and 
what is .still happening to liim. Collcge.s, however, are not in a 
favored {•tosltion as far ns contact.s with the Immc are concerned. 
On many campusc.s lirdf fvr more of the students have their 
homes at some geographic distance from tltc campus. We 
secure very little information from the home and very little 
about the home except as the student may give it to us on a 
personal history blank or in the interview. 

Many counselors arc appropriately fearful rif any direct con- 
tact with parents because of the rlanger of re.setumcnt from the 
student or the danger of a tran.sfer of emotionally immature 
attitudes from parents to coun.sclor. These clangers are real 
but no more so than the fact tliat, although the counselor or the 
college docs not U'ish to act in loco parentis, it is frecjuently 
forced to do so without adeejuate knowledge of the parents that 
it is tempejrarily replacing. 

Any analysis of tlic significant arca.s of information about the 
student will place information on lunnc cotniitions and parental 
influences high on tltc list, 'riicrc is little done, however, to 
establish channels through which such information can come 
except as action must be taken in an emergency. I have no 
pat solution that will apply to all situations. There probably 
is none, but I ask for more sharing of procedures that have 
worked in given situations and more formal publication on this 
topic for college workers. The college stnde7it is not so old that 
we can leave parents and home out of the picture. 

Secondary Schools. —W g arc much too isolated from the 
secondary schools which give us our students but here there are 
some hopeful signs of solution. The term “articulation" is 
familiar to all of us in education. It is written into our Asso- 
ciation Charter under the topic of coordination with pre- and 
post-college agencies. Much that has been done on articulation 
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has been in terms of admissions standards and curricula. These 
are important but important also is a flow of information from 
the high-school counselor to the college personnel worker. This 
continuity between counselors, between total personnel pro- 
grams in high school and m college is a weak spot. 

I spoke on this subject earlier this month at a meeting in 
Portland, Oregon, of the Northwest College Personnel Asso- 
ciation and four other personnel groups that it had brought 
together. I mentioned the information form used by the 
Ohio College Association and a blank developed some years ago 
by the California Educational Research Association. Dean 
Golda Wickham, of the University of Oregon, showed me a 
blank used by the college and high-school deans of women in 
that area. All of these bring pertinent information to the 
college counselor from the high-school counselor. 

This same northwest area has an Inter-State Committee on 
High School-College Relations with a Sub Committee on State- 
wide Evaluation of High-School Students. May I quote two 
paragraphs from a recent report of this committee, of which 
E. H. Hopkins is chairman: 

After considerable study and deliberation by the subcom- 
mittee, the subcommittee recommends that the original con- 
cept of the proposal be revised to include a much broader 
objective than merely statewide testing. It is felt that the 
program should aim to develop many and various means of 
individual student analysis (tests, inventories, personal data 
sheets, cumulative records, refinement of uniform application 
blanks for admission to colleges and universities, et cetera). 

In addition, it is felt that the program should not only be limited 
to methods of individual analysis. It should assume some 
responsibility for providing professionally sound assistance to 
high schools m inaugurating the program and in developing 
sound evaluation and guidance programs generally. 

The long range program should be aimed toward better 
guidance of all nigh-.schoql students, not just those who are 
primarily interested in going to college. It can be assurned 
that these objectives will be greatly facilitated by a cooperative 
and coordinated program. _ This program should be designed 
to secure adequate and valid personal data regarding each indi- 
vidual student and to utilize these data to the best advantage 
of the individual student. 

Such a program is articulation on a cooperative basis that 
will bring the colleges closer to the high-school environment. 
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It will also increase the mutual respect of each unjup for the 
other. 

We nui.st not restrict mir unitacts with the high school to 
iiiimission tiata or inloimatioii hlanfc.s. 'I'lic personnel staffs 
of the (\u) units must share iilcas ami prohlcms. This will give 
us at the tollege level "flu* foci” of the high schorjl .md its pro- 
fessional piohlems. Thi.s c.tn hest he dtme in statewide or even 
smaller gmupings. Jny collc^ir /xTsm/iri shijf can well afford 
to initiate piofessional meetings with the eounsclor.s and prin- 
cipals of its nearby feeder sehord.s. .Something can he done. 

-The Cinssruam. ( )n the college campus itself there is isolation 
of the pcnsonnel program rrf)ni the elassrooju and from those 
who teadi in it. 'I'lie teacher and the curriculum are the most 
important influences in the campus life of the .student, impor- 
tant in the .sense that he was atimitted in terms of curricular 
requirements ami imrst (wotjre.ss in relation to them if he stays 
on the camjnis. We may talk all we like about stiulent inter- 
ests outside of the elassnifim. they .ire manifohl and vital, but 
the clas.sroom jnirs the "fiee*’ on him and he know.s it. He must 
satisfy the faculty ami he know.s that. Those of u.s who believe 
that the non aeademie interests of a student are important 
should he mosifamiliiiv with eurriculur and teaching influences 
in his life hecause they are so influential in his development. 
It is a question not only of our knowing wdiat the classroom 
teacher trices to do but of the teacher knowing in his language 
what we are trying to do. Industrial personnel luis gone some- 
what further than we have in this interpretation of personnel 
goals and jirocedurcs to the operating staff. They must do this 
to exist. A former student of mine, Vance jewson, recently 
talked to the top management in his company in an attempt to 
explain the values of careful selection. lie used concepts 
having meaning to them and from liis statement I should like 
to quote a jniragiaph or two, 

t. Why do we have a psychological ctnmsding and te.sting 
section? 

A, Because we are in a competitive labor market in our 
.search for top-notchers. 

B. Hecause our primary inve.stnient is in people. Kvery 
.salesmen hired repre.sent $250,000 investment. 
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C. Because of need to reduce training costs and training 
time. 

D. Because of need for making personnel relationships 
profitable. 

I. Minneapolis Honeywell is not an elementary insti- 
tution. We have a yen to survive, and we must 
develop these human relationship programs if we 
.survive. This is not out of a sense of chai ity but out 
of a sense of intelligent realization that if oui business 
democracy i.s to survive more attention must be given 
to intelligent recruiting, selection and placement of 
people. 

1. Realization that our casual methods of handling em- 
ployees and our casual methods of intei viewing were 
not profitable. Many of our casual methods in years 
past have been more compaiable to the methods used 
in judging livestock, or used cais. We have a depart- 
ment head who even now .say.s: “Let me see how the 
person walk.s, and I’ll tell you what kind of a worker 
he will be!” Our tendency to form judgments fiom 
handwriting, shape of the head, and the phy.sical 
features, certainly has proven unprofitable Our per- 
.soiial biases, picjudices, favoritism, unreasonable 
prefeiencc foi one group of people over another, 
general disiegard for evidences of promi.se that may 
appear on an application blank, or in an interview, 
with a statement — “It’s too bad you don’t have the 
experience” — all aie examples of common-sense 
thinking that lacks scientific evidence to support it. 
That kind of handling is too costly. 

E. Other factors that have led us to improve our personnel 

facilities: 

1. Unhappy workers (as illustrated by examples pre- 
sented), supervisors — customeis — interfere with pro- 
duction. 

a. Hidden costs in correspondence, expense accounts, 
company cars, errors in judgment. 

3. The money cost involved in transfers from one end of 
the country to another and from one department to 

another. , , • 1 • 1 

4. Our failuie to know the psychological job require- 
ments makes for costly errors. All these consider- 
ations have led us to feel a need for embarking on a 
new approach to our problems. 

Can we explain our services in. terms as meaningful to faculty 
as these are to business management? I think we can but we 
have notl’gone far enough in doing so. 

There ‘is another approach, that of a sense of cooperative 
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effort and of joint concern with tlie teacher. We can help the 
faculty to help students, once we know the classroom and keep 
up with curriculum demands so that we can talk a common 
language with the teacher. Most teacliers know ^)xc, prohkins 
of dealing with groujis and often feel incompetent in handling 
them except by lecture. Let me give you a paragraph from 
another former student, David Jenkins, who is with the Center 
for (rrouii Dynamics, now at M.I.'I'., soon to move to Michigan. 
In a paper to a regional guidance conference in New England, 
Jenkins said; 

The counselor, who is the .speciali.st in prohlcm.s of individual 
adjustment, .should Iwcciiiie the lesource person fur the teachers 
in matters of making then classrooms good places fur adjust- 
ment. This would mean tli.n the counselor would not only 
need to he skilled in techniques of individual contacts with 
students, hut lie would also need to become skilled in the tech- 
nitpves of group leadership and group behavior. Solving the 
problems m the classroom l>e/(ire they arise seems much more 
efficient than having to attempt a cure after the problem ha.s 
become acute Preventive counseling seems as .sensible as 
preventive medicine 'I’his suggestion would mean that the 
classroom group atmosphere aiul the club atmosphere and the 
.student council atiiiosphere would all lx; the concern of the 
counselor and he would be called upon to advise the teachers 
and student leaders in ways and means of improving them. 

If this sounds idealistic then lememher that ideals and new 
ideas precede intelligent change. To carry out the suggested 
integration with the classroom wc will have to develop skills in 
group management and therapy and wc will have to find the 
teachers with whom wc can work. 

Our isolation from tlie classroom, with marked exceptions of 
individuals who now teach undergraduate courses or have 
taught fairly extensively, seems to me to be caused by two 
factors. In the first place, personnel people arc apt to consider 
themselves us administrators or as psychological specialists and 
therefore remote from ordinary classroom activitie.s. They for- 
get that the student is nol remote from these influences and that 
the personnel worker must take tltem into account along with 
counseling and extra-classroom influences. The second factor 
is the “reverse cnglish” of the first in that the Faculty all too 
frequently considers personnel workers and the personnel pro- 
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gram remote from the classroom. This is chargeable to our 
negligence in permitting the student personnel program to 
develop without faculty action and support in policy making. 

Spiritual Resources . — ^To state that the student personnel 
program is isolated from the spiritual resources of the campus 
and community is perhaps to express the fear that we have over- 
intellectualized our approach. In a desire to reject sentimen- 
talism and traditionalism we have developed objectivity and a 
scientific approach. We have not meant to neglect the great 
intangibles and emotional experiences of life m this piocess, but 
it seems to me that we may have been doing so. In our fight 
against emotionalism we may have “thrown out the baby with 
the bath water.” We have become objective and missed the 
significance of the subjective realities of experience, become 
fact-minded and missed the Importance of the casual, and be- 
come intellectual and missed the dynamics of the spiritual 
in life. 

I am well aware of the difficulty of expressing my convictions 
on this matter. The above paragraph seems to me to consist 
of words and more words but to carry none of the intense feeling 
that I would like to transmit to you. For example, what is 
meant specifically by spiritual resources? Well, there are two 
or three answers to that one. 

I. Religion is one of the great spiritual resources and pro- 
fessional people seem to be afraid of It. Our forefathers were 
not, and I question the likelihood that we have advanced so far 
ahead of them in understanding the deeper meanings of life. 
We have not grown away from religion but religion in reality 
and in the lives of students may have grown away from us. 
That is our real tragedy. Personnel workers are aware of the 
struggle going on within students because of the clash of new 
ideas and new freedom with what is often an immature and 
formalized religious experience. Students come to college as 
immature in spiritual realization as they are in intellectual 
activity. We help them to greater maturity in thinking. Why 
not also to greater maturity in living? We are concerned about 
social life, and health, and accuracy of intellectual conclusions. 
We have social directors, student organizations, health services 
and discussion groups to hiring about growth in these areas of 
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living. Why not a juogram and a ctiordinator for those experi- 
ences which contribute to the meaning of life as well as to its 
process ? 

Many church affiliated schools have chaplains and chapel 
services. Kven here I have occasionally found the personnel 
worker akwf from thi.s part of the campus life, he may even be 
faintly contemptuous of it. 'I’lierc may be good reason to look 
askance at the formaliml religious exercises. There may be 
much cant and .superficiality there. But such a condition does 
not deny the profouml need in the life of a student for a sense 
of values and relationship to something greater than himself, 
There are crooked politicians and there is much hypocrisy in 
politics but our obligation at the polls i.s all the stronger because 
of these conditions. 

Church affiliated campuses have their own unique problems 
in the area of religion. They have a great chance but they may 
muff it, I'he personnel worker on such a campus should be 
close to the experiences in the livc.s of his students that are 
brought about, for good or for ill, by the religious program 
of their campus. The state or non-sectarian institution some- 
times rises grandly to the occasion, sometimes ignores the whole 
situation. I am thinking of the chaplains on the staff at Lehigh 
University and Stanford University. I am also thinking 
proudly of the recent appointment at the University of Minne- 
sota of a Coordinator of Religious Activities, a man employed 
by the Minnesota Council of Religion but a member of the 
personnel staff of the University under the Dean of Students, 

2. Another great spiritual resource on the campus is the 
presence of great music, lasting art and beauty in many forms. 
Beauty is so manifold and is so necessary a part of rich and 
satisfying living that personnel workers should know well and 
use well every facility for beauty in the life of the student. By 
thorough acquaintancesliip with the resources for artistic and 
aesthetic satisfaction on the campus and in the community the 
personnel worker is himself enriched and thus contributes both 
directly and indirectly to the emotional life of the student. 
Professional people of all classes, with personnel workers no 
exception, are apt to emphasize the intellectual at the expense 
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of the aesthetic. We must of course “live by our brains” and 
tolerate no less than our best intellectual effort but the man who 
sees no more than ideas and facts in life is poor indeed. Does 
the personnel worker on any campus know his symphony 
recordings, his local chamber music or a capella choir, the per- 
manent or travelling art exhibitions, the spots from which the 
best mountain or lake or sunset views can be seen, the wooded 
walks, the peisons in whom greatness lives and to whom to talk 
is a benediction ? If he does not know these and other sources 
of enrichment how can he understand students and their grop- 
mgs toward beauty or how can he provide for richness in the 
daily lives of these students? 

A third spiritual resource on the campus lies in nothing so 
pervasive as religion, in nothing so obvious as music or art, but 
in the human relationships that fill our lives. The love of a boy 
for his mother or Dad, for his friend or for his sweetheart is a 
powerful influence in his development. This love, or the lack 
of it, goes far to explain behavior which we say is irrational and 
emotional. The fact that it is emotional makes it no less real 
or of no less value We should not condemn behavior because 
it can be labeled irrational We try to understand such behav- 
ior in a given individual, wc place it in a category and try to get 
at causes, but do we recognize it as possible good rather than 
evil and use these loves and friendships as resources in the lives 
of students? Do we do more than joke with him about his 
sweetheart, or even question his right to fall in love, ignoie his 
loyalty to a friend and shy away from “sentimental” talk about 
his parents? We are apt to be concerned about a student’s 
grades, vocational choice and methods of study. These are 
important factors in living but we must at least appreciate what 
the presence or absence of satisfying human relationships does 
in his life All we have to do is to see how these influences shape 
our own lives. 

I have been suggesting that the isolation of the personnel 
program from what I have called spiritual resources is the result 
of both organizational and personal deficiencies. A program 
that gives little attention to the factors of religion, beauty and 
love as resources for growth is a poor thing indeed. Of course 
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these arc sensitive tfjpies, not to he handled crudely or even 
obviously. But a good program will make it easy for students 
to develop these pliases of living. 

As for the personnel worker himself, all that he can do in 
pcnsonal relationships may depend upon his close acquaintance- 
ship with the spiritual resources of the campus. He must be 
k7iown as a person who is more bioadly concerned with life than 
is suggested by his preoccupation with regulations, tests, com- 
mittee meetings and research stiulies! These sound pretty 
dry -as a matter of fact they are! .A man’s acquaintanceship 
with musical events, the church, outdoor life, sports, casual 
and relaxed social life, soon becomes known and students see 
a man as a man and a woman as a woman, interesting in them- 
selves, not just as a title or the symbol of a regulation. 

More than merely Ixiing known as a distinct and vivid per- 
sonality, a personnel worker should be one. Tire man or woman 
who has become so old or who has dried up his inner resources 
of emotion so that he no longer enjoys a hearty story, sheds a 
tear, exhibits “irrational enthusiasms,” seeks quiet moments 
for communion with God, or laughs at his own peculiar behav- 
ior, has lost much of his or her effectiveness as a personnel 
worker and as a person. 

This paper has presented four weaknesses in the conduct of 
our student personnel programs: a lack of qualifications and 
training standards, poor piolicy making, poor organization, and 
isolation of personnel workers and personnel programs from 
vital influences in tlie life of the student. These are all trag- 
edies but the last of these is the greatest. It is "the greatest 
tragedy.” 

The thesis that I have been trying to present with regard to 
isolation is that a personnel program whose chief function is the 
inlegration of a student’s experiences and the development of a 
many-sided life cannot afford to be isolated from the great 
influences in his life. The tragedy lies in the fact that isolation 
is the antithesis of integration. We cannot, of all things, re- 
main in isolation if we are to supply the channels for integration. 
We must know the nature and extent of home influences, we 
must develop professional relationships and channels of com- 
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munication with secondary-school workers, we must keep in 
close touch with college classroom and teacher, and above all 
we must show in our own lives that we appreciate the warmth 
and richness of religion, beauty and love. To do all of these 
things well will challenge us for the rest of our lives. I never 
want to be satisfied — and as long as I am in the college per- 
sonnel field I am sure that I never will be. 
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Introduction 

With a strong conviction that totiay we are confronted with 
more questionji and with fewer answers than at any other time 
in historyy I .iccepred the invitation to speak on the subject 
which has just been anmninced, witli tlie hojie that collectively 
we can find some of (he answers to some of the questions, while 
there is yet time to do something ahout them. 

I am wondering if there is not a fairly cf)mmon agreement 
among us with respect in what most of us consider to be the 
essential elements and qualities of a student personnel program. 
So far as I know, no modern educator denounces, at least 
publicly, the "student personnel juiint of view," which is so 
well known to all of v'lU, and which 1 shall discuss briefly a 
little later on. 

At this point, let me .state very briefly the outline of my 
paper, It may be helpful to you in tying it all together: First, 
I shall merely list those e.s.sential and siicciali/cd student per- 
sonnel services, which in one form or another, must be provided 
as an integral and inseparable part of any program of higher 
education, Second, I shall list a group of basic and funda- 
mental principles and assumptions, which are just as essential 
as the student personnel services themselves, 'third, I shall 
make a plea for "optimum" instead of "minimum” essen- 
tials in student personnel work, and education generally. 
Fourth, there is a degree of urgency about all of this which we 
as educators, and as citizens, have not fully appreciated, or, if 

‘ Pewom wliofic commentt iirt not recorded, but who gave aimlysis and recom- 
mendations are Robert H, Mathew.son, Associate Professor of Education, Harvard 
University; Lawrence A. Kimpton, Dean of Men, Stanford University; John H. 
Cornehlsen, Jr,, Dean of Men, Snn mnci.aco .State College, 

The session was sumraanvid by Wendell S. Dysinger, Dean, MncMurray College. 
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we have, we have done little about it. And last, I wish to 
single out for special consideration and discussion two of the 
eleven essential principles which I shall propose, 

Essential Student-Personnel Services 

For the sake of brevity, I shall merely list eleven specialized 
student personnel services, which I consider to be essential to 
a sound program of higher education, Each of these could be 
discussed at length, but let us merely assume that each of these 
services should be organized, coordinated, and integrated into 
the total educational program, in a sound and effective manner. 
With this assumption, I shall eliminate further discussion with 
respect to the “hows” and “whys” of these eleven essential 
services. They are as follows: 

I . A program pre-college counseling, selection, and applicant- 
centered admissions. 

2,. An organized program for diagnosis and counseling of 
students. This includes both intensive clinical counseling and 
the normal day-to-day educational and personal counseling 
provided by the faculty and other less professionally trained 
counselors. 

3. An effective orientation program, spread throughout the 
entire first year. 

4. Remedial assistance in various areas for those students who 
need it. 

5. Definite provision for the supervision, coordination, and 
integration of the "co-curricular'’ program on the campus. 

6. A student health service, providing professional services in 
areas of both physical and mental health. 

7. An adequate program oi supervision of living arrangements , 
including the food service program. This program must be 
provided in such a manner as to contribute to the maximum 
extent possible to the social-educational objectives of the insti- 
tution, as they relate to the individual student. 

8. A well-organized program for administering financial 
aids, student employments , post-graduate placements, and job 
follow-ups. 

9. Special facilities for developing and evaluating the reli- 
gious life and interests of students on the campus. 
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10. 'rhcre imist be tlcvi.scil and maintained an adequate 
system of permanent lumuh/ive personnel records, which in- 
clude pertinent information relative tt) all a.spects of student 
life and student accomplishment. 

n. .'It the pre.sent, and for the next few years, a special 
service providing for the coordination of J’eteran's afairs is an 
essential part of the total )>r<»gram. 

Admittedly, this list of specialized student personnel services 
is not an exhaustive one. Kach of you probably can add others, 
but generally speaking, these appear to be the most essential of 
the special services included in a comprehensive .student per- 
sonnel program. 

Haste Principles and Assumptions 

There arc certain basic princijde.s and assumptions which are 
just as essential as are the student per.sonncl services; hence, I 
should like to call attention to the more im]H;rtant of these: 

I, Idrst, of course, is (he student per.snnnel point of view, 
which I luuc already mentioned. If mu.st be considered as 
the fimdamental and basic principle underlying the total pro- 
gram. You arc already familiar with thi,s jioint of view; hence, 
as important as if is, I .shall not discu.ss it further. It is well 
defined and described in the .‘\mcrican Council on Education 
pamphlet, entitlcxl Phe Student Personnel Point of View, pub- 
lished in T937. In essentially the .same form, and in 1938, it 
was adopted as the first chapter of the cliarter of this associa- 
tion. It is just as up-to-date in lyqK as when it was adopted 
in 1938. Certainly, I shall not attempt to improve on that 
definition or description of the general philosophy of student 
personnel work. Furthermore, since it is so well described in 
the chajter of this organization, I am obviously aware that I 
am not telling you anything new. 

a. The second principle, to which I have also referred briefly, 
is the necessity for thorough-going and effective coordination 
not only between and among the services and principles them- 
selves, but between the services and tlie instructional program. 
This coordination must prevail both horizontally and vertically, 
not only within the institution, but with the pre-college pro- 
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gram and with post-college adjustments A program of stu- 
dent personnel services, of and by itself, just does not exist. 

3 Education and the processes of education are strictly 
individual processes. The individual student must be con- 
sidered as a total unique personality Consequently, education 
must be flexible to the needs of Individual students. I am 
reminded of a statement made at this meeting a year ago in 
Columbus, by Dr. Edwin S. Burdell, Director of the Cooper 
Union, when he asserted that "if a curriculum does not meet 
the needs of a given student, it is a poor curriculum for him, 
however much appioved it may be by the pedagogical pundits 
who dreamed It up.” This principle of considering the indi- 
vidual student as an individual is absolutely essential to a sound 
program of education which is based upon the student person- 
nel point of view Furthermore, there is nothing in this prin- 
ciple which IS in conflict with the social objectives of education; 
there is no dichotomy between education for the needs of the 
individual and education for the improvement of society. 

4 Educational programs, policies, and procedures cannot be 
established at least in a healthy manner by administrative edict 
or by fiat, These are matters demanding the combined wits 
and wisdoms of the entire faculty — with the additional help 
of the students. In addition, such a democratic policy is psy- 
chologically necessary for the success of the program. 

5 Another essential principle, at least as it applies m co- 
educational institutions, has reference to what I consider to be 
a psychological fallacy apparent in some institutions where 
separate and parallel organizational structures prevail, one for 
women students and one for men students. I, of course, have 
reference to the traditional “Dean of Men” and “Dean of 
Women” organizations. Therefore, I consider it a sound 
principle to assume that the problems of men and women 
students on the campus are of the same order, and that the 
principles and methods for solving them are the same. Con- 
sequently, one progiam of services should be provided, not two, 
Both men and women counselors, teachers, and administrators 
are needed, and each should work with both men and women 
students — in one program, 
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6. 'I'hc cnllcuf c;ini|uis, hnrh in action aiui in spirit, must be 

made an efficient /or /rahiinx hi democratic living. 

7. While I have no intention, here and now, of listing all of 
the principles or assumptions basic to educutinn generally, there 
is another cilucatioiud fir {fs}-cholf*gical prineijile which I regard 
as being so closely akin to the objectives of student personnel 
services that I should like to mention it. I have reference to 
the concept of ‘'deferring the .selection of a major.” The actual 
pnicess of ‘'selecting a major” is an individual student process, 
and a mental process. Therefore, there can be no institutional 
edict which says categorically to the student that you may not 
select a major Held of stiuiy until "such and such a time.” On 
the other hand, there should he a policy which prevents students 
from bt'ing forced into such dcci.sit)ns too early in their college 
careers. Along witlt this principle goes a strong endorsement 
of the principles and ohjectivc.s of general education, but not to 
the exclusion nj training /or jobs. .A strong and effective 
program of pre-college counseling, and higli .school-college 
articulation, will eliminate some of the reasons for a deferred- 
major jKiiicy, but it will not eliminate tlie need for general 
education, 

8. As a principle, student di.scijiline, in the broad as well as 
the narrow sense, must be judiciously administered and in such 
a manner that the individual student will be strengthened and 
the welfare of the grau[' preserved, 

9. As mentioned before, a student personnel program does 
not exist, per se, in spite of the tendency of most members ofthe 
fiiculty to tliink so, and to act accordingly. Consequently, 
when we refer to the essentials of "the student personnel 
program,” we must necessarily refer to "higher education 
generally,” We simply cannot talk about student personnel 
work, in educational institutions, without talking about edu- 
cation itself. Student personnel services are education. We 
must assume that both the objective and the methods of 
student personnel work, and of education generally, are abso- 
lutely inseparable, if not identical. Probably you are thinking 
that it is trite and hackneyed to be told this again — because I 
am sure that every person in this room subscribes to the principle 
that student personnel work is not merely a fifth wheel — but I 
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submit to you that in most institutions, even where the essential 
student personnel services exist as such, the student personnel 
point of view has not permeated the faculty ranks, the adminis- 
trative staffs, the curriculum committees, the admission boards, 
the reinstatement committees, nor the educational policies 
committees which are responsible for the educational practices 
within those institutions The plain truth is that student 
personnel work still is considered by far too many faculty 
members, deans, and presidents simply as a fifth wheel. And 
they are not referring to the “steeling wheel.” Consequently, 
it is imperative that you bring the entire faculty, administration, 
student body, and alumni into active and constructive partici- 
pation in the practical implementation of the program. I shall 
say more about this later. 

10. In discussing the principle of “faculty participation” and 
other sound principles of organization, I should like to cake issue 
with one of the currently accepted university organizational 
patterns, which organizes the President’s office into four 
divisions, namely, the academic, the student personnel, the 
business management, and public relations. This organization 
logically calls for a "Dean of Faculty,” a “Dean of Students,” 
a “Business Manager or Comptroller” and a “Director of Public 
Relations or Public Information.” This is the current trend in 
the larger institutions. I am aware that on many campuses it 
has been a struggle for status, particularly for the Dean of 
Students, oi Director of Student Affairs. I am indeed happy 
that on many of these same campuses, the Dean of Students 
now has a parallel position with the Dean of Faculty, That is 
appropriate. However, I do not concur with an institutional 
organization which permits the student personnel program on 
the one hand, and the academic program on the other, to be so 
separated that they are brought together only by the President 
I know of no president who has the time to really integrate 
these two equally important educational aspects of the program. 
Consequently, in the larger institutions, I recommend an Edu- 
cational Vice President, whose first and most important job is 
to really bring together, almost into one, the instructional 
program and the student personnel program. 

11. There must be a principle, a policy, in fact a plan for 
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continuous uppraisnl and evaluation of the program and a 
williu^ncss to adjust and readjust it to fit changing conditions. 
Closely related to thi.s principle, in fact u part of it, is the 
compelling need for curriailar and student personnel research 
at all levels of the higher educational ladder, but most im- 
portant at the post-graduate level, i,c.. a follow-up of our 
graduate.^, and for that matter of all others who leave our 
schools iMtfore graduation, in order to find out what are the 
results of our particular brand of education. Just how effec- 
tively are we doing what we propose to be doing? This point, 
also, I shall discuss later. 

I have outlined briefly what I consider to be the essential 
student personnel services in higher education; I have supple- 
mented this list of services with eleven basic or fundamental 
principles underlying their implementation. There is abso- 
lutely nothing new about any of them. These arc the services, 
the facilitie.s, the .special bureaus and offices, the specially 
trained staff's- and the basic principles -for which we have 
been striving in our more progressive institutions for the past 
ten to twenty years. In the majority of our institutions we 
now luive most of thc.se services in one form or another. What 
more do we want? Where wc have had these services, just 
how adequate and how effective have they been? To what 
extent have they served their intended purposes, particul^irly to 
the masses of the students? And what changes arc we going to 
make, or can wc make, if and when the goals of the I^resident’s 
Commission on Higher Education become a reality, that is, 
with reference to increased enrollments? 

Too Much Emphasis on ‘'Minimum Essentials” 

Upon a more penetrating reflection about the real meaning oi 
student personnel services, the real meaning of education itself, 
and their common if not identical objectives, I am wondering if 
we cannot take a fresh and more timely view toward the student 
personnel program anti, in fact, toward higher education 
generally. 

In the first place, I am reminded of the Office of Education 
publication, published, I believe, in the middle ’thirties, en- 
titled Minimum Essentials oj a Guidance Program; for our 
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purposes, it might just as well have read, “Minimum Essentials 
of a Student Personnel Program ” I fear that too many of us, 
and our deans, our presidents, and our governing boaids, think 
too frequently m terms of mmivium essentials, when thinking 
of the student personnel progiam in our respective institutions. 
Why should we put ourselves so clearly on the defensive? 
Why should we show such lack of confidence, such half-hearted- 
ness, such weakness of moral courage, when we try to sell the 
student personnel point of view, and the kind of program which 
will put that point of view to work? That point of view, with 
which we are all familiar and to which we all subscribe, is of 
little consequence until and unless we put it to work in rather 
concrete and practical situations. If higher education gener- 
ally is going to face up to the tremendously urgent and compli- 
cated social, economic, and political issues in our fast-moving 
and relatively unguided civilization today, we must stop think- 
ing about minimum essentials^ minimum facilities, minimum 
qualifications , minimum salaries, minimum evaluation, minimum 
research, minimum standards, and minimum services to the indi- 
vidual and to the community. Indirectly, we have been apolo- 
gizing for what we have to offer, by asking merely for minimum 
essentials. Perhaps we have not called them that, and in some 
cases probably we have not even been aware ourselves that we 
were seeking merely minimum essentials. 

If we really uoant to make education effective, if we really 
•want to prepare individual students for effective and full living, 
if we really •want to save civilization and democracy within the 
time limits whicli may be upon us, let us start defining the opti- 
mum essentials of education, and gear these essentials and their 
practical implementation to the immediate problems facing edu- 
cation today. Let us direct our thinking, and therefore our 
actions, toward the matcimtim potentials from optimum con- 
ditions, rather than toward the limited potentials from minimum 
conditions. Without this kind of forward thinking, without 
this courage to face reality — and I mean facing reality in 1948, 
not in the distant future — we might just as well toss whatever 
strength we have into the military machine and wait for the 
consequences. 
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Urgency /nr X(mr flffecfhr /Itj^/itr KducatUm 

In asking fnr optimum «m»lirioii}, we must stress the urgency 
of our [uirjKise, an<l we must also get across the idea that we 
have no “vested interests," no selfish motives, no axes to grind, 
but that these conditions are essential, and essential now, if we 
are to tlo the kitnl of jf>b we must tier for our own survival, 

The recent rejmrt of the Pre.sidcnt's Commis.sion on Higher 
Education certainly is not based ujxm minimum essentials. It 
is the most forward-ItKjking, most sensible, and most practical 
approach to higher education generally that I have yet seen. I 
am thoroughly convinced that our respective institutional 
publics will willingly, even enthusiastically, support an optimum 
progrant for higher education, joroe/Vrey we can produce the evi- 
dence for its neeti, plus the evidence of our ability to produce 
tangible results. These two provisos, and ]>articularJy the 
latter one, jdace a tremendous re.sponsibility upon our own 
shoulders. I pray to (Jod that w’e are hig^ enough for the job. 

The situation is both critical and urgent and further compli- 
cated by emotions of fear, distrust, prejudice, selfishness, in- 
difference, and general ''uneasinc.ss." 

This "uneasiness" and its consequent fearful speculation are 
very real, and undoubtedly represent a significant “cross-roads" 
in civilization as we know it. The first ejuestion is “Can we 
survive?” and the second, “I low can we adapt ourselves to the 
new age if we do survive?" In cither case, the “cross-roads" 
unquestionably is here. But let us concentrate on the first 
question; there is no time in this discussion to concentrate on 
the second. What consequences are likely, if we become a 
world frightened by our own disorganized eflforts to cope with 
it? If fear is an individual’s greatest enemy, as the psycholo- 
gists say it is, k is a far greater enemy of a nation — or for a 
world —because in an individual, therapy is more easily and 
more effectively administered. We must meet this world-wide 
fear with understanding and with education. We must meet 
distrust, prejudice, selfishness, and indijfference, likewise, with 
understanding and witJt education. Blow else can we bring 
about changes in the attitudes and motivations of individuals, 
except through education? But do we have the “stuff” in our- 
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selves and in our ranks to provide the leadership needed in 
these critical times ? I am confident that we do have, but it is 
absolutely essential, and essential now, that organized education 
in this country come decisively to grips with the worldwide 
crisis of mankind. We cannot afford to let this crisis just “take 
its course.” 

President Hutchins has made an apt statement, in speaking 
of college administrators generally, and I am strongly inclined 
to believe that his statement characterizes both you and me, 
regardless of our particular jobs He says, in effect, that we 
get ourselves so busy with the immediate and urgent problems 
of our jobs that we never have the time, nor do we take the 
time, for the really important matters needing our attention. I 
believe rather keenly that we get ourselves so “wrapped up” 
and so involved in our jobs, and in our daily routines — and 
many of them are routines — that we have not taken time out to 
provide whatever leadership and attention we are capable of 
providing in matters related to the really important issues in 
education and to our national and international situation. We 
get ourselves so “tied up” with details and seemingly immediate 
and urgent matters, that we fail to view our jobs, our insti- 
tutions, our students, and particularly our products, with the 
kind of perspective needed for objective, or even subjective, 
evaluation of what it is we are trying to accomplish. 

The second urgent and compelling reason for a fresh view and 
a revitalized program of higher education based upon the 
student personnel point of view is the fact that too often our 
graduates simply do not measure up to our expectations, to 
their own capacities, or to the demands of the society of which 
they become a part. While there is continuously mounting 
evidence which clearly indicates this weakness in higher edu- 
cation today, for the sake of brevity I shall use but a few 
references. Perhaps the overall problem in this connection is 
nowhere better summarized than in the Editor’s Foreward to 
Robert Pace's report of the Minnesota study, completed just 
prior to the war, entitled ^hey Went to College. I am aware 
that this study has been widely quoted, but I hope it is re- 
peatedly quoted, especially to audiences of educational adminis- 
trators and college faculties generally. This foreword, as you 
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would expect, i.s luiscii upon the fiiulincrs of the study, in which 
Pace reported rm the differences between eollctie graduates and 
nnn-t;t;uiuutes, at the rniversity of Minnesota. I quote; 

\Yc‘ need despc! .itely to know why tlicre appears to be little 
t»r no ddference between grailuatcs and nongraduates, between 
high-ranking students and low-ranking students, after they 
have k’cn a decade away ft«)in the campus. Why nuwt of 
them api>ear to w.int security and coiiteiitment m.stead of 
taking a vigorous delight in 'looking upon the bright face of 
danger* and welcoming blooil-stirring cliangc. Why, if we 
have taught them far above tlicir fellows - to think critically, 
they arc m after-college years so obviously uncritical and in- 
consistent in their thinking. Why, if we have taught them to 
read good books, most of tiiem read only ‘slick' magazines of 
huge circulation, ncwspinx-rs, a few books of a standard below 
that of the freslmuin b'.nglisli class Why, in a democracy, the 
most highly educated people wc have fail so miserably to en- 
gage in coninuimty and politic.ii activities. 

With respect to the pcr.sonal lives of tire graduates and non- 
graduates, let me quote from the summary: 

The CTfiieial College faculty, however, were led to ask 
pointedly whether or not colleges should feel satisfied with the 
picture descrilied here. ‘I’lieir ovcrwlielining conviction was 
that they should not. 

One of the factors giving rise to this di.ssatisfaction was that 
in almost none of the many activities utul cliaractenstics sur- 
veyed were there any difFerenecs iHitwecn the graduate.s and 
nongraduates. Those who completed their college programs 
were no different in any notable respect from those who failed 
to complete them, What few difterences theic were seem 
almost random or accidental rather than expected outcomes of 
an additional two or three years of college training. 

And, from page 78 of the same study, I quote: 

If these scattered and limited differences between graduates 
and nongraduates reprc.sent tlie measure of effective education, 
then it behooves educators to take more .specific, direct, and 
active respomsibility for the life goals, philosopliies, person- 
alitie.s, cultural interests, and recreations of the young people 
with whom they woik. 

Much more could be said with respect to the need for an effec- 
tive student personnel program, one which is thoroughly 
meshed into the total educational program and which would be 
capable of producing products of which we could be proud. 
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fust take a look at our attrition rate, throughout the country, 
where from fifty to sixty-five per cent diop out befoie embark- 
ing upon the third year of college. Just take a look, without 
even a pretense at scientific evaluation, at the appropriateness 
and efiTectiveness of the training which from year to year is 
being given those who do drop out along the way. Just find 
out, in your own institutions, what percentage aiyour students 
do not know what occupational objectives they wish to follow, 
or for what general occupational pattern they are best fitted. 
Just find out, in your own institutions, the extent to which indi- 
vidual students are following intelligent and -planned college 
careers. Just find out, if you can, on your own campus, how 
many who would be far better adapted to terminal and more 
practical training, are still endeavoring to conform to high 
academic requirements, demanded by prescribed curricula 
leading to the bachelor’s degree. 

While this picture is a rather discouraging one, representing 
a combination of a ci ideal, serious, and urgent national and 
international situation, and what appears to be an inefficient 
and ineffective educational system, I do feel that tliere are ways 
out My faith is still stronger than my fears, but faith, and 
faith alone, is of little value if used as a cloak. We must be 
realistic. This is no time to "play ostrich." With American 
optimism what it is, and since we have not only the proved 
capacity for effective "esprit de corps, but also the proved 
capacity to actually "do things, let us examine the problem 
from the more positive side. The force of necessity, in Amer- 
ica, still remains a powerfully strong psychological weapon, but 
we cannot stand idly by. 

Although I do not recall the specific reference, I recall reading 
not long ago in another article by President Hutchins in which 
he made some such statement as this : 

As a means to a peaceful world, education is either every- 
thing, or else It i.s nothing; if it really is everything, then it 
.should be encouiaged, implemented, financed, and ^ade to 
work; if on the other hand, it is nothing, there should be no 
more time nor money wasted on it. 

I think we agree on the fundamental importance of education, 
I think we agree that it is everything, so far as progress is con- 
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cerned. We agree on tlie wisdom of the student personnel 
point of view in education, but apparently we have had Utde 
agreement on what constitutes the most fruitful means of 
putting this jwinf of view and education to work. 

Positive Approaches 

In the light of this setting: first a war-torn, tattered, and 
unstable world; second, a rather unenviable record of civic and 
social participation and contribution on the part of tlic average 
college graduate, as compared with non-college graduates; and, 
third, a heterogeneous and conglomerate mass of student per- 
sonnel and educational practices being used and misused 
throughout our respective institutions; I should like to focus 
more attention on two of the eleven essential principles which. I 
mentioned at the beginning of this paper:y/r.f/, the principle of 
getting more active faculty participation in the implementation of 
the student personnel point of view, and secondly, the need for 
many more facts, i.c., curricular and student personnel research. 
While all of the principles and assumptions outlined earlier are 
important, I feel that tlie greatest immediate need is for the 
practical imjjlementaticm of these two jiostulates. 

Regarding the first: if wc arc going to have an effective edu- 
cational program, based truly upon tlie student personnel point 
of view, that point of view must be known, believed, accepted, 
and practiced by the teacliing faculty, by the administration, 
and by those responsible for the specialized services within the 
institution. In your efforts to secure this participation, prob- 
ably you will succeed in getting ready acceptance of your objec- 
tives and purposes, but the translation of these into “action 
patterns” will be the more difficult hurdle. And yet, we have 
talked and we have talked and we have talked about these 
objectives, in high sounding and highly acceptable terminology; 
but if we really mean what wc say, we must devise the means to 
accomplish this objective. This is essential—- but "How”? 
This is where you come in — in fact, it is your first essential. 
We must first create an organization, a faculty, in fact an insti- 
tution, which by its composite and coordinated efforts, by its 
sound educational policies which will have been put into action, 
will do for the masses what a few counselors and a few instruc- 
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tors have beea trying desperately to do for too few students. 
Certainly, I do not mean that you will eliminate the need for 
individual counseling by specially trained and qualified workers 
— we will always need the specialists and probably more of 
them than we can expect to get — but we will get far greater 
results with the masses of our students, if we provide on a 
wholesale and preventive basis, what we have been attempting 
to provide on a retail and therapeutic basis. It is comparable 
with the effects of a public health program. You need rela- 
tively fewer physicians in a community having an intelligent 
and carefully administered public health program than in com- 
munities where no such program exists. Such are the possi- 
bilities of an educational program when all of its forces are 
brought to bear upon common objectives. 

This would be merely empty “mouthing” if I did not believe 
that we can go a long way, in a relatively short time, toward the 
development of this kind of a program. You are the people 
who must carry the torch; you must become crusaders, and 
maintain that zeal and enthusiasm, along with a necessary 
amount of patience and diplomacy, until the process begins to 
“take.” More than ever before, you must devise better means 
of informing your faculties, and doing it repeatedly, of the sig- 
nificance of the student personnel point of view. In weekly or 
periodic staff bulletins, report and review individual cases, 
report and review tlie kind of facts which Pace reported in the 
study of the 951 graduates and non-graduates of the University 
of Minnesota. If possible, find out these facts from your own 
institution and your own students. Also, report continuously 
and repeatedly what other institutions are doing, significant, 
urgent, and compelling statistics on such matters as student 
failures, student drop-outs, the criteria for success and the 
reason for failure on post-graduation jobs, and the failure of 
college graduates to assume more than a minimum of civic 
responsibility. 

If no such weekly or bi-weekly staff bulletin exists in your 
institution, create one, with the support and participation of the 
important policy committees of your institution. There is a 
virtual wealth of current, factual, pertinent and suggestive in- 
formation available, which, if handed on to our teaching 



444 * Dt'CATIUN'AI. AS'n I'.'-Vt tlOt.CK.U' At. .Mt Ast RhMKNT 


faculties itnd .idinintfstrafnrs. I .ini positive: would stimulate 
both thought and action. 

Wliilc heretofore on our own campus we have published some 
such information in our weekly .staff bulletin which is' a combb 
nation news .sheet and cantpu.s calendar of events, I have in 
mind creating a new staff bulletin, to be devoted exclusively to 
matter.s of educational iinjmovement.s policie.s, principles, 
facts, ncw.s, research results, surveys, and opinions which are 
pertinent to our own educational program. If sufficient and 
pertinent information could he gathered, caiefully screened, 
edited, or rewritten in a fa.sliion for your own campus consump- 
tion, and then dis.seminated to your entire faculties, over a 
period of time I think you might be amav.ed at the effect. 
Stimulate faculty disciussions, faculty meetings, panels, visiting 
lectureships, radio programs, debates, and seminars on current 
issues in education. A.sk faculty mcinber.s to review, for publi- 
cation in the weekly .staff bulletin and for small group discus- 
sions, such IwHiks as Howard Mumford Jones’ lulucaliou and 
H'orlil ^rra^edy, Donham's Ixiok cut Education for Responsible 
(iiviny;, Cord Meyer Jr.’s recent hook entitled Peace or Anarchy, 
the Harvard Report on General Education in a Free Society, the 
A. C, H. Cooperative Study in General Education, or McGrath’s 
recent hook, ’■Toward General Education. 'I’here are literally 
dozens of such hooks, pamphlets, surveys and reports which 
should be called to tl\e attention of your teaching facultie.s and 
administrators. 

Why not prevail upon your President, your Dean of Faculty, 
or your Budget Committee for enough money and it would 
take a surprisingly small amount — to purchase sufficient copies 
of the Report oj the President's Commission on Higher Education 
so that each department in your college w’Ould have copies of 
the complete report, and Insist that it he rotated among the 
members of the re.spectivc departments until all liad read it. 
The reading of that report .should be an ab.solute requirement of 
every person who justifies his name on a college faculty payroll. 
Also, for a very small budgetary consideration (75)i per year 
per person), your institution can subscribe to Higher Education, 
the semi-monthly publication of the Higher Kducation Division 
of the U. S, Office of Education; I recommend it as a good in- 
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vestment by the institution for every single member of your 
faculty. If that cannot be done, I recommend it for all Deans, 
Directors, Departmental Chairmen, and the members of your 
curriculum and policy committees. Other publications of sig- 
nificant value, and of a form adapted for wide and economic 
circulation, are the Intercollegiate Press Bulletins, a weekly 
news letter devoted to current college events published by the 
American College Public Relations Association, and What the 
Colleges are Doing, published by Ginn and Company. From 
these three publications alone, in addition to your own pro- 
fessional journals, and perhaps School and Society, you will have 
enough source material to publish a short but extremely valu- 
able weekly or bi-weekly mimeographed bulletin to your faculty 
colleagues. 

How many of you take time, or make time, to visit regularly 
with members of your instructional staff to discuss with them 
common policies and procedures, institutional objectives and 
your joint responsibilities for achieving them, to encourage or 
solicit constructive criticism from them, to demonstrate through 
a discussion and consideration of their teaching and research 
Interests that you understand and appreciate their important 
role in the overall educational program of the institution? 

This year on our campus we inaugurated a series of monthly 
faculty meetings, for all members of our faculty; such meetings 
are devoted exclusively to lectures, discussions, and panels 
covering matters of current educational and faculty personnel 
policies. Although our faculty probably is as busy and over- 
worked as the average faculty, I am happy to say that these 
meetings have been unusually well-attended and unusually 
successful. As a result we have set aside $10,000 for next year, 
to bring to the campus outstanding authorities, consultants, 
and visiting lecturers on matters of current educational interest 
to the faculty 

Another example of the degree of genuine interest in, and 
willingness to participate in and contribute to, a dynamic 
program of educational improvement on our own college 
campus, was demonstrated a few weeks ago when I called for 
volunteer memberships on a large number of subcommittees of 
the Educational Policies Committee. It was understood that 
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these subcommittees were to delve deeply into such matters as 
“improvement of instruction and the relating of instruction to 
contemporary issues," “integrated courses,” "instruction in 
community, national, and international affairs,” “student 
counseling," “graduation requirements,” “a deferred-major 
plan,” "the integration of student activities into tlte educative 
processes,” "terminal education,” “how to teach worker edu- 
cation,” and a number of others. With faculty members 
already “committied to death,” you would be astonished to 
know tliat we had approximately one hundred and fifty faculty 
volunteers who indicated both an interest in, and a willingness 
to serve on, such committees. Those committees are going to 
stir up a lot of grass-roots thinking on the Washington State 
College campus within the next few months, and the next year. 
Our faculty has just completed working out its own plan for 
faculty evaluation. Tliis means appraisal of faculty perform- 
ance and effectiveness in areas of instruction, research and 
publications, and in over-all benefit to the institution and to 
the community. 'I’hey have now asked tliat the faculty be 
evaluated by the students and by the alumni. They are deeply 
interested in self-improvement and in the improvement of 
instruction and education generally. Our faculty voted, as a 
result of their own deliberations, not merely to adopt a deferred- 
major plan, but to place the administrative responsibility for 
the entire lower division in the hands of the Dean of Students 
and his student personnel staff. This plan has been in oper- 
ation for two years. They arc sold on it, and are improving it. 

In connection with institutional committees, may I suggest 
also that you, as student personnel workers, have an important 
and urgent role to play in the determination and implementa- 
tion of educational policies within your respective institutions. 
Therefore, you should see to it somehow that you and other 
selected members of your student personnel staffs are placed on 
such committees as the curriculum committee, educational 
policies committee, admission policies committee, and other 
important committees charged with policy determination 
functions. Also, on your important policy committees, place 
some of the best students on your campus. If you have not 
already tried, this, I think you may be both amazed and pleased 
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with the nature of the contribution which they can and will 
make. 

The second postulate on which I wish to focus more attention 
has to do with the dire need for curricular and student personnel 
research to guide us in our policy determinations. How on 
earth can we expect to develop new curricula, new programs of 
study, proper combinations of general and specialized courses, 
integrated courses which we know are effective, adequate 
vocational and other counseling services, student activity 
programs which are supposed to train for democratic living, 
sound admission policies, sound re-instatement policies, sound 
and defensible graduation requirements, when we do not even 
know what the effects and the results of our present curricula, 
instruction, and services are? 

We set up admission policies without knowing what really 
makes for success in college. For example, we are still clinging 
to high-school graduation and certain patterns of high-school 
subjects, when we have known for years that there is no scien- 
tific basis for believing that high-school subject-matter patterns 
are related to academic success in college. 

Each year we admit large new freshman classes, the largeness 
of the classes being made possible by the graduation of one 
group and the dropping out of another. Usually the drop-outs 
will exceed the graduates; and yet, each year, for the most part, 
we continue to expose each new class of freshmen to the same 
curricula, the same requirements, the same rules, and the same 
services which had already eliminated more than 50 per cent of 
each preceding freshman class for the past several years. For 
those who were not eliminated prior to graduation, i.e., those 
who succeeded in being graduated, we frequently do not even 
have their names on the alumni mailing list, to say nothing of 
our failure to know anything about what they are doing, how 
they are adapting to their jobs or how successful they are tech- 
nically and professionally. We do not know whether or not 
they have been able to cope with the complexities of society, 
whether or not they are leaders in their respective communities, 
whether they are criminals, or patients of mental hospitals. 
But — each year, it becomes our first order of business to take 
care of our new freshmen! That comes first! 
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Can yt)u imauiiu- any other hig business, or even small 
business, which would continue production year after year, with 
lieavy investments required year after year, without even an 
inquiry as to the quality and the substantiality of its product? 
Fartunatcly, for most manufactured products, the consumers 
arc tile primary ap[)raisers and evaluators of the products. To 
a certain extent, this is true with the consumers of college 
graduates the enqdoycr.s; but when the graduate does not 
happen to measure up, it is the graduate’s fault — not the fault 
of the schtml. It just could not be the school’s fault— -after all, 
look at all the good men wlio liave been graduated from that 
school! Yes, even in spite of the school! Frankly, I do not 
really mean to say that all our curricula, and all our instruction, 
and all our services, are bad; I know they are not. But, I am 
saying that in most case.s we do not know how good nor how 
bad they really arc. We should certainly find out. 

In addition, we should know far more about the students 
who come to our camjmses for educational training. Before 
we admit them, we should know something of their aptitudes, 
interests, })ersonality characteristics, as well as their scholastic 
achievements. Wc liave no right to admit them, and then 
later to tell them tliat we are sorry, but wc just do not have 
what they need. Usually we do not even tell them that; they 
struggle along for a year or two, and then discover for them- 
selves that not only arc tlicy swimming upstream, but up the 
wrong stream. We need to know what the individual needs of 
our prospective students arc, and in addition we need to know 
the overall pattern of individual, social, and employment needs 
of the regions which we serve, if we are to fulfill our missions 
efficiently and to the best of our abilities. 

In my opinion, the effectiveness of any educational institu- 
tion, and therefore the effectiveness of its governing board, of 
its President, and of those others responsible for educational 
policies and practice.s within the institution, should be measured 
by the quality of the product wliich the institution produces. 
This, of course, assumes that the qualities and qualifications of 
the product would have to be measured, and measured con- 
sistently and continuously. It means, in all in.stitutions, that 
such studies as the one reported by Pace at Minnesota should be 
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made, and the data should be kept current. “But,” you say, 
“this would cost money.” I can only say that it would cost 
far less than what is now being spent providing teaching facul- 
ties, services, housing, and other provisions for the students 
who are “swimming up the wrong streams,” not to mention the 
loss of time, money, prestige, and “face” of each student in that 
category. Consequently, if we really are interested in develop- 
ing an educational program based upon the student personnel 
point of view, let us find out a little more about the individual 
needs of those students who come to us for training, the social 
and employment needs of the regions which we serve, and the 
effects and results of the training which we are now providing 
for our students. T‘his research is essential, and you are the 
people who are best qualified and who are in the most strategic 
positions to carry it on. You are the persons to see to it that 
the findings of such research become the common property of 
yortr administration and your faculty. 

Summary 

I The essentials of a student personnel program consist of' 

a. The student personnel point of view as applied to all 
educational processes; 

b. A group of at least eleven specialized student personnel 
services, requiring specially trained counselors and 
technicians; 

c. Certain basic and fundamental principles and assump- 
tions which apply to all phases of the program. Eleven 
such principles and assumptions have been specifically 
mentioned. 

2. We must strive harder than we have ever striven before 
for “optimum” conditions and the wherewithal to carry out an 
effective educational program. 

3. We must devise countless practical and spirited means of 
transforming the student personnel point of view into insti- 
tutional and faculty action patterns-™not only as a long range 
objective, but as an immediate one. 

4. Through scientific research we must get at the facts which 
are basic to an intelligent and effective program. W e must 
know wherein we are ine^eettve or weak. 
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5. 'Diere is a degree of urgency wliich we can ill afford to 
ignore. In short, all that I have been trying to say is that it is 
high time that we cnnie cUm-n from the ivory towers, that we 
face the urgency before us. that we follow the courage of our 
convictions, and dcvelojv an educational program which will 
bring about the full realization and meaning of democracy h 
action. This means an educational program which will turn out 
emotionally mature men and women capable, willing, and 
desirous of acting intelligently in a world where men depend 
upon men, and in a civilization which de[>ends upon under- 
standingvS among men. In the words of the President’s Com- 
mission on Higher Kducation, “the resjwnsibility for the 
development of these personal qualities (in our students) can no 
longer be left, as heretofore, to some courses, or a few depart- 
ments, or some scattered extra-curricular organizations; it must 
become a part of cccry phase of college life," 



PROFESSIONAL STANDARDS AND TRAINING 
FOR COLLEGE PERSONNEL WORKERSi 


GORDON V. ANDERSON 

Assistant Director, Testing and Guidance Bureau, University of Texas 

The topic of the present discussion is Standards and Train- 
ing for College Personnel workers.* The problem is that of 
arriving at some judgment of what standards should be set for 
college personnel work, and how those standards can be satis- 
factorily applied; and also of outlining what should be con- 
sidered a minimum essential training program for college per- 
sonnel workers, probably also with recommendations of what 
training beyond such minima personnel workers should have. 

In approaching the general problem, it is probably desirable 
to review the scope of college personnel work. No disagree- 
ment on this is likely. It is generally recognized that college 
personnel work concerns itself with the extra-instructional or 
extra-class activities of the college student; but that is not to 
say that it is unrelated to class work and to the curriculum. 
This point is often lost sight of, unfortunately, and personnel 
work is too often thought of in terms of housekeeping and 
policing functions. Wc need frequently to remind our aca- 
demic associates that the effective functioning of a personnel 
program contributes to more effective instructional work. 
On the one hand, when students engage in class work, it should 
be after steps have been taken to insure that they are ready 
to profit by such instruction, and that its objectives are also 
those of the students. Furthermore, when the student is as- 

^ Persons whose comments are not recorded, but who gave an analysis and made 
recommendations arc: Ruth Strang, Professor of Education, Teachers College, Colum- 
bia University; Willard W. Blac.sser, Dean of Students, Washington State College 
Dewey B Stuit, Dean of Student Personnel Services, University of Iowa, summarized 
the session. 

•This paper embodies the report of the Committee on Standards and Training. 
The Committee is composed of: Leona E. Tyler, Chairman, Director of Bureau of 
Personnel Research, University of Oregon; the author; Anna L. Rose Plawkes, Dean of 
Students, Mills College; E. H. Hopkins, Vice-President, Washington State College, 
andE K Smiley, Director of Admissions, Lehigh University. 
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sistcd in making a mote i-tTcctive adjustment in the total college 
situation, it may he expected that his general orientation will 
be such as to make him a more efficient student in his course 
work. This docs nor mean mere attention to administrative 
factors, such a.s to have student.s well houseti, supplied with 
adequate health .services, to have available a diversified social 
program, etc. It goes /ifyuiui thi.s to a con.sideration of the 
interpersonal and intrapcnsonal dynamics which influence 
.student adjustment in even the hc.sr of jihysical facilities. 
Furthermore, a well-functioning per.sonnel program has values 
of its own to eontrihute, so that out-of-cla.ss experiences which 
students encounter themselves akso become influences con- 
tributing to the growth and maturity of the student. While 
coUcge.s are in.stitutions oricntctl urouml cla.ssroom instruction, 
there arc none of us who fail to rccognive that students learn 
just as much outside as in the classrotnn, and often develop 
skills and acquire information which a classroom .situation 
would he unable to deal with efieetively. 

But we cannot arrive at any eonclusifin concerning standards 
and training from such broad generalities. We must be more 
specific in our approach. Jones* has diseus.sed three ajiproaches 
to the problem of the preparation of personnel workers, which 
are relevant to the [)rcsent discussion, 'riiese are: 

1. The attempt to fuul what perstaincl wtu'ker.s do; wliat their 
duties and re.spoiisibilitics arc. These attempts have taken 
the form of jolt analyses from observation and from the 
.statements ol personnel workers themselves. 

2, The discovery of the patterns of knowledges, skills, atti- 
tude.s, interests and eluir,icteri.stic.s necessary for the suc- 
cessful performance of these duties and respcmsibilities. 

The determination of types of courses’, training and experi- 
ences that are most effective in developing the patterns of 
abilities nece.ssary for .success on the job. 

Very little research has been found in any of these ap- 
proaches. Reliance has been placed rather on statements made 
by personnel experts of their judgments with regard to each 
point. 

The w/ta/e problem of "sfandariJs of practice" in personnel 
work is pretty well left aside in the present discussion insofar 

’ Jones, Arthur J. “Preparation of Personnel Workers." lieoino of Edncalhnal 
Researeli,XV (1945), 185-I90 
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as it relates to what kinds of situations personnel workers should 
operate in, and to the resources and facilities which should be 
made available for effective functioning. This might raise the 
problem of institutional standards. The question of the 
relationships which should hold between personnel workers 
and other college officials, and the relations of personnel 
workers with students are given little attention, although 
there has been a rising amount of literature on these points 
and on the closely related one of professional ethics, during the 
past few years. 

The problem of training standards is dealt with rather 
specifically, and in dealing with the general topic of training, a 
number of related questions present themselves: (i) Should 
we concern ourselves witli the common training which all 
personnel workers should be expected to have, or should 
training for specialties within the field of work be defined as 
well? (2.) Should different standards be set for various types 
of college personnel positions? (3) What recommendations 
should be made with respect to the possession of advanced 
degrees? (4) Should experience requirements be established, 
including experience in non-academic work? (5) Can stand- 
ards be set in such a way that persons will be selected for and 
survive in training programs who possess the personality 
characteristics generally considered desirable? (6) How 
should standards which are agreed upon be handled adminis- 
tratively? Should some form of certification be introduced? 

The first difficulty that confronts us as we attempt to set up 
reasonable standards is the wide variety of positions in different 
institutions. Rather than to attempt a job analysis of every 
position carrying some sort of personnel title, it seems more 
feasible to begin with a list of functions which it is quite gen- 
erally agreed that the institutions should perform More than 
ten years ago a committee of the American Council on Educa- 
tion formulated a list defining 23 personnel functions. We 
have used this list, somewhat condensed, as a comprehensive 
outline for organizing an approach to standards, These func- 
tions are as follows: 

I. Interpreting institutional objectives and opportunity to 
prospective students, their parents, and to workers in 
secondary education. 
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2. AclmitMng.stiulcnts in ciKiperatinn with secondary schools. 

3. Orienting the new .student to hiv college envirotiment, and 
keeping lorn coiuinuoudy and adequately informed of the 
educational opportunities and .services available to him. 

4. I’riividsng counseling scrvicc.s which, with the aid of diag- 
nostic facilities and other referral agencies, assi.st the .stu- 
dent in adjusting to and planning for hi.s educational, voca- 
tional. einntional, social, and religious growrh. 

5. Il)etcrmining tlie pliysical and mental health .statius of the 
.student ami providing appropriate health service. 

6. Providing and .sujXTVising an atiequate housing program 
for .stutlenfs. 

7. Providing aiul evaluating an adequate food service for 
.Students. 

H. Developing, .siqiervising and evaluating a program forstu- 
tient activities. 

(j. Assembling and making availalilc information to be used in 
improvement of instruciion and in making the curriculum 
more adjustable t<i tlic needs of individuals. 

10. SujXTvising and coordinating the program of financial aid 
and part-time employment of students, and counseling the 
student who needs to obtain such lielp. 

n. Assisting the student to (hid appropriate employment when 
he leaves the institution and following up the .student 
after he has left the institution. 

la. Keeping .student picrMtiincl records and making them avail- 
able to the prcqier persons. 

13. Regulating student conduct to the end that the individual 
will Iw strengthened and the welfare of the group advanced, 

14. Maintaining student group morale by evaluating, under- 
standing anti developing .student more.s. 

15. Carrying on research studies designed to evaluate and im- 
prove pensonncl functions and services. 

It IS possible to combine these functions in such a way as to 
represent groups of personnel occupations which apparently 
require similar types of special skills, We have centered our 
recommendations on the levels and types of training to be 
required around this grouping. The titles of positions under 
which some of these duties are carried in some institutions may 
have been omitted, since no survey of positions was made, 
but such omissions can easily be corrected. 

Since all personnel workers have as their central aims the 
welfare of the Individual student and his adjustment to the 
college situation both in and out of tlie classrooms, it has seemed 
to us that training for ail should be built around a common 
core. This should Involve information with regard to in- 
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dividuals as individuals and as members of groups. It should 
also include the development of skill in identifying individual 
needs and problems and handling interview and group leader- 
ship situations constructively. The committe has not specified 
any certain number of courses or length of time to be spent in 
covering any of these areas. The Association may eventually 
wish to set up an examination to determine competency rather 
than to assume that exposure to courses guarantees it. We 
have not given specific course names, since at different institu- 
tions the same type of training is offered sometimes in the 
Department of Psychology, sometimes in the College of 
Education, sometimes in a special personnel training program. 
We would recommend that in each of the areas listed, the 
trainee take enough work to acquire more than a superficial 
familiarity. Basic habits of thinking about human beings from 
a consistent scientific point of view; actual skill in performance 
of fundamental personnel functions are the goals at which we 
should aim. The common core should include the following; 

I. The psychology of personality, its development, organiza- 
tion and dynamics. This should include a number of 
viewpoints in regard to the dynamics of human adjustment 
(e.g,, Freud, Lewin, Allport, et al) . Flexibility rather than 
dogmatism in dealing with individual cases should be pro- 
moted. Work in abnormal psychology and mental hygiene 
should be included in order to familiarize the trainee with 
the symptoms of serious mental disorders, particularly so 
that he will know when referral for special therapeutic serv- 
ices IS necessary or desirable. The trainee should become 
familiar with the general course of human development 
from infancy to maturity, with special emphasis on the char- 
acteristics of the adolescent period. He should be able to 
recognize signs of immaturity for whut they are and to 
understand the characteristic problems of the older ado- 
lescent. 

a. Social Psychology with especial attention to the nature, 
origin and extent of individual differences, and to group 
organization and inter-group and intra-group relationships. 

3. Principles of learning. Since the personnel worker's job is 
to facilitate the educational process for the student, he needs 
to have a thorough understanding of liow people learn, and 
what factors aid or disturb the learning process. 

4. Mental tests and their interpretation. Here especially super- 
ficiality is to be avoided, since mental tests are not in a stage 
of evolution where the results can be taken at face value and 
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II' cd IKK ."illy 31 ) ((V .»).(!> fil’ut) iisdjVKhml JUTsonality. 
.Stafistnal luuii’S'taiiihng shrrtild invnlvc iiutre tiuiii the rec- 
Ilf rlic meaning nf different types of relative score. 
Kmpha'i' '-limild he piai'cd, li<iv>cvt'r, cm inforniutinti leading 
tu the ciincct nttn ^rclutif,n r.ttiter tliaii cm the administra- 
tioii and soil ing td tcots nr tlu‘ nianipulatinn of statistical 
fctrmul.ie. 

c;. lyuenidcm^ and tounfrlhi^ prorcdurcs, 'rhis* training 
slitadd JiH'lndt* actual ptaitace in Imth the traditiunal inter- 
view teel)ni<]vif- designed tu cthrain and to itnpart infcinna- 
iKin and the newer ncm-directive pretcedures. 

h. Hi^Iicv fJuctiiiMi. Its phslusophy, urganr/.atiim and admin- 
istiatiun. 

Besides the course work taken in regular classes, the stand- 
ards for each perstninel position should provide for a period of 
su[)crvised experience in t)ic general type of work the trainee 
desires to enter. Again no exact mmiher of hours or months 
has been set in thi.s rejKirr but can he added if the Association 
feels it should be specified, .^uch experience should not be too 
narrowly ilefmetl. Ff>r a person who wishes to be !i dean of 
men, for example, it would not be necessary that Ite actually 
take an internship in a dean's oriice. Work a.s a dormitory 
sponsor, student intern in the Counseling Center, etc. would be 
just as acceptable. The grouping of personnel positions form- 
ing the basis for the special training recommendations could 
determine the organization of tliis part of the program as well, 
'rhus an institution training student personnel workers could 
set up internships in the record-keeping division, the student 
activities division, tlie counseling division, and the employ- 
ment service, 

Tliese two retiuircmcnts, a common core of studies and a 
period of supervised experience, would hold for all types of 
personnel positions. For each of 5 defined types, we have also 
set up certain special training requirements and a minimum 
academic degree. They are as follow's: 

I. Portions rcciuihiig as.senibling and recording of data about 
individuals, formulating and carrying out of admission-s 
policicvs, keeping of records, and planning and carrying out 
research studie.s fium lamsonnel files. 

A. Naine.s of positions commonly found in this group: 

T. Director of Admissions. 

a. Registrar, 

3. Personnel Re.search Director, 
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B Academic training minimum-one year beyond the 

Master’s degree. (PhD recommended for Research 

Director.) 

C. Sp^ial types of training in addition to common core: 

1. Bu.sine.s.s and/or educational administration, cover- 
ing office management, record systems and filing, 
accounting, etc. 

2. Large scale filing and personnel accounting 
metnods, including use of punched card equipment. 

3. Advanced statistical methods. 

II. Positions requiring direction of student activities and 

organizations, orientation of new students, regulation of 

student conduct, etc. 

A. Names of positions commonly found in this group. 

I. Director of Student Activities. 

1 . Dean of Students. 

3. Dean of Men. 

4. Dean of Women. 

5- Student Housing Director. 

B. Academic training minimum — one year beyond the 

Master’s degiee, positions i to 4; M.A. degree for 5. 

C. Special types of training in addition to the common 

core. 

I. Education courses emphasizing extra-curricular 
activities, diagnosis of learning and motivational 
problems, development and use of personnel 
records. 

a. Sociology courses on group interaction, group 
therapy, etc. 

Ill, Positions chiefly conccined with the counseling of indi- 
viduals. 

A. Names of positions. 

1. Director, Student Counseling Service. 

2. Personal Counselor. 

3. Vocational Counselor. 

4. Educational Counselor, 

B. Academic training minima 

1. Director — Ph.D in psychology or its equivalent in 
education or combined program emphasizing 
counseling. 

2. Personal Counselor — Ph.D in psychology, with 
specialization in counseling. 

3. Vocational and Educational counselors — Master’s 
degree in psychology, education, or combined 
program. 

C. Special types of training, 

1. Occupational analysis and information. 

2. Advanced educational and psychological measure- 
ment. 

3. Psychotherapy, 
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IV. I’u'sitious cliicliy < (Au'erneti with testing. (In many insti- 
tution;., tlicsc iisnul(i Ik- uidiuied under III above, since 
the testing (if individuals is a part of the counseling 
process. Siine institutions have, however, a large scale 
te.ting program involving function g, "assembling and 
making available mfonnation to Iw used in improvement 
of instruction,’' as well as the .service to individual 
students theniscis’cs. I 

A. Naiiu’S of positions commonly found in this group. 

1. Director, Ktudent Testing .Service. 

2 . Psychoilietrist. 

Director of Research (listed also under I above). 

B. Academic training minima; 

1. Director -Pli.D. in psychology or education with 
emphasis on evaluation and measurement. 

3. Psycliumetrist Master’s degree, with emphasis on 
admimstration and interpretation of tests. 

C. Special tr.ainmg. 

1. Advanced .statistical methods. 

2. Test cfinstruction. 

V. Positions concerned with student employment and gradu- 
ate placement, and .administration of finaneial aids such 
as loan funds, scholarships, etc. 

A. Names of positions, 

1. Director, Kmployment Service. 

2 . Interviewer. 

B. Academic training minima: 

1. Dinictor •Master's degree in psychology, business 
administration, or education, with emphasis on 
vocational problems. 

2 . Interviewer — Baclielcir's degree in one of the above- 
mentioned field.s. 

C. Special training. 

1. Occupational analysis and information. 

2 , Office management, record .sys'tcm.s, etc, 

Two types of personnel service arc included in the list of 
functions with which we started, but not in the special training 
recommendations. The first of these consists of positions for 
which recognized standards are already set by some other 
accrediting agency. Physicians and nurses in the Health 
Service, and dieticians in the dormitories would fall into this 
category. I'he other consists of a number of part-time and 
non-professional personnel service, such as the work done by 
faculty advisers, dormitory sponsors, housemothers, etc. It 
would seem to be advisable to let the person in the adminis- 
trative position under whom these activities fall set up stand- 
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ards for them which are in accordance with the goals of the 
program of the particular institution. 

We have also omitted from our classification the position of 
Director, Dean, or Coordinator of all personnel services. We 
would recommend that he be chosen from the ranks of persons 
trained in accordance with one of the special programs out- 
lined above. Thus he would be sure to satisfy all the basic 
requirements in addition to possessing the particular adminis- 
trative talents such a position requires. 

If these recommendations were adopted by the Association 
there would yet remain the question of their effectuation. 
The committee did not consider recommendations along these 
lines to fall within its scope. It is the sense of this group, 
however, that certification of college personnel workers for 
these variously defined positions should not be contemplated 
at the present time (Related to this question is that of the 
status of psychologists within the ACPA who will be certified 
by the American Psychological Association Board of Examiners 
for educational personnel work.) 

We do not feel that it would be helpful to the growth and 
integration of our profession for a set of standards, if adopted, 
to be used as a basis for rating personnel workers now actively 
engaged in college and university work. These standards 
are not equated for the value of years of experience in this 
field which have made some of the members recognized authori- 
ties who may lack the formal training specified in these recom- 
mendations. 

It is hoped rather that as standards are set up they will be- 
come criteria for the training and selection of college personnel 
workers now in training or who will enter training in the 
future, and as a guide to personnel administrators for the selec- 
tion of college personnel workers in our schools in the future. 
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I’rcMilcnt, KcKwvelt College of CKlcago 

I SHOULD like to state at the beginning that the absence of 
quotas in tlie admission of minority groups into Roosevelt 
College has not created unusual headaches for our adminis- 
trators. There is no basis whatsoever for hysterical fears about 
interracial marriage, spread of social diseases, lowered academic 
standards, or the spread of irresponsibility. VVe are a perfectly 
normal community of six thousand men and women, dedicated 
to respect people as people, without regard to the color of the 
skin or the tenets of their religious creed. Our student prob- 
lems in general are of normal scope and intensity. Our 
standards of honesty, cleanliness, health, industry, and attitude 
indicate that minority groups do not bring with them a wave of 
unusual social, moral and physical problems. To contend that 
they do would he absolutely contrary to the facts as we have 
experienced them. 

I do wish, however, to bring to your attention three specific 
problems which minority groups in our schools must face, and 
to indicate how wc at Roosevelt College are dealing with these 
problems: 

I. The problem of discrimination and undemocratic adminis- 
trative control. 

1. The problem of inequality of achievement. 

3. The problem of restricted opportunity in job placement, 

'The Problem of DiscrimwaHoii and Undemocratic 
/Idministrative Control 

It is difficult to determine the exact influence which boards of 
control have upon the details of school administration because 
no systematic study has ever been made of exactly what goes on 
inside of board meetings. It is also difficult to prove the 
hypothesis that minority group problems in a school flow, in 

460 
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part at least, from tlie kind of administrative control which the 
school has. A recent study did indicate, however, some inter- 
esting facts concerning the boards of control of our thirty-one 
leading universities; 

1. The control of our universities is almost entirely in the 
hands of the top 9.5 per cent of our socio-economic group as 
classified by income. 

2. That men in profirietary, legal, and managerial occu- 
pations represented 48 per cent of the boards of control in i860, 
and that representation increased to 73.6 per cent of the boards 
of control in 1930, when the last survey was made. 

3. When polled on the question of academic freedom, 34 per 
cent of the trustees acknowledged in writing that the scope and 
freedom of teaching should be restricted.' 

But, we are still left with this question: Exactly how does 
control of schools by the top socio-economic classes create 
problems for minority groups in our schools? I do not mean to 
suggest that race prejudice and high socio-economic status have 
positive and significant correlation. Certainly, we recognize 
that some of the bitterest and most irrational prejudices are on 
tlie lower socio-economic levels. I am suggesting, however, 
that the quota system is, to say the least, related to the type of 
upper middle-class mores which have dominated our schools 
since the nineteenth century. I am further suggesting that one 
of the greatest problems the Jewish, Negro, or other minority- 
group student faces, whether he is in high school or college, is 
the quota system if he wishes to continue his education. I am 
suggesting that this oppressive atmosphere of a quota system 
poisons and warps social, political, and moral attitudes and 
creates serious guidance problems among minority group 
students. 

The quota system tries to be rational and humane by paying 
lip service to the American ideal that the underdogs (at least 
some of them) deserve a chance; it argues that quotas are 
democratic because student bodies must be “representative.” 
Quotas seem plausible because they are expedient; they seem 
non-vicious because they are subtle and allow a token type of 

' Beck, Hubert, T. Me}} Who Control Our mhersttiei. New Vork; King's Crown 
Press, 1947. pp. 61-62, III, 
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interracialism. At the liottom ol the quota system lies the 
assumption that inintdiy qroups are inferior; without this 
assumption there woultl he no objection to a non-quota system 
based on merit. The quetta system is a kind of “gentlemen’s 
agreement’’ which is a strtmg characteristic of the mores of the 
upper middle-class citizen in America. It is the so-called “best 
citizens,” as we measure tlicm by socio-economic status, who 
control our .schoohs and therefore impose the quota system on 
peoples thtty consider inferior. 

If members of minority groups are fortunate enough to gain 
admission to schools of liigher education, they face two prob- 
lems closely related to the quota system: 

lurst; Many schools and colleges have an administrative 
hierarchy which i.s a iikkIcI of authoritarianism. 

Second; Negroes and Jews face an elaborate set of social 
divseriminatory practices on college campuses. 

The President's Commission on Higher Kiducation recognized 
the danger in an umlemocratic administrative hierarchy when 
it stated: 

To actiieve practice m democratic action tlie President’s 
Commi.ssion recommcnck a careful review of administrative 
policie.s in inhtitution.s of higher learning; revision may be neces- 
sary to give .student.s every po.s.sible experience in democratic 
processe.s within the democratic community. Young people 
cannot be expected to develop a firm allegiance to the demo- 
cratic faith they are taught in the classrooms if their campus 
life is carried on in an authoritarian atmosphere.* 

In order to wipe out the problems of an authoritarian admin- 
istrative hierarchy (which is a problem for all students) and the 
problem of social discrimination against minority groups on the 
campus, I suggest the following: 

1. That faculty members be given a greater voice in adminis- 
trative control. 

2, That the philosophy and basic aims of the school be so 
stated that a complete air of freedom exists on the campus, 

As a contribution toward this first goal, Roosevelt College 
sought to establi.sh a new kind of board of trustees. A striking 

•"Establishing the Goals." Higher Eduention for Amerieatt Demoeraey. Vol. I. 
Report of the President's Commission on Higher Education. Washington; tJ. S. 
Government Printing OfRce, 1947, p. 14. 
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feature of our Board is the large voice exercised in it by the 
Faculty. Of the twenty-one members of the Board, five are 
elected by faculty members from the Faculty. Furthermore, 
the Board is composed of representatives of business, labor and 
the professions; the Board is also interracial and intercreedal. 
It truly represents all the main segments of life in the Chicago 
community. With this organization, no segment of the Board 
can control the academic and administrative processes in line 
with its particular ideas. So far as we know there are only two 
Negroes serving as trustees of any college which has white 
students. Both of these Negroes are on our Board. We know 
only four other colleges which give labor a voice on their boards 
of control. Of the some 30,000 men and women controlling our 
institutions of higlier learning, we know of only seven persons 
from the ranks of labor. There is only a token representation 
of Jews, and women, the largest American minority group, are 
poorly represented, even on boards of coeducational institu- 
tions. Is it unreasonable to suggest, therefore, that the inade- 
quate representation of large segments of the American people 
has been a cause of minority group problems m our schools? 

As to the actual administration of Roosevelt College, the 
President and the Deans must request a vote of confidence from 
the Faculty at the end of each third year. The “yes” or “no” 
vote is by secret ballot and its purpose, in the case of the 
President, is to convey to the President and through him to the 
Board, for its guidance, the sentiment of the Faculty. The 
vote of confidence on the Deans has a similar purpose. Our 
Departmental Chairmen are elected for terms of three years by 
the President, tire Dean of the particular school and members 
of the Executive Committee after the voting members of the 
department have filed their “recommendation.” Members of 
the teaching staff are appointed by the President after hearing 
the recommendation of the Dean of the school in which the 
appointment is sought and of the Chairman of the Department 
and its voting members. The Faculty enjoys the right of re- 
calling any officer it elects. Furthermore, any full-time em- 
ployee of the College has the right to file a grievance and a 
formal grievance procedure is outlined by which complaints 
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cvL-ntUidly may !)r larricii all the way tri the Board of Trustees, 
if necessary. 

We Believe that this is a democratic administrative .structure 
which uives us an unparalleled opportunity for free inquiry into 
any conttciversial area. Thus we feel that we have eliminated 
restriction, either direct or indirect, which might be exercised 
hy a conservative hoard of e<tntroI or by the vested interests of 
an entrenched administrative hierarchy. 

As to the creation of a greater atmosphere of freedom, the 
only .mswer is tt> estahli.sh a school w’hich refuses to count 
people or consider them on any other basis than as people. The 
recent stand taken by the National Student Association is 
eommendalile. It i.s high time that other discriminatory 
practices among students arc abolished. Home of the most 
vicious discrimination is ftwmd in the fraternity system. Our 
.students arc now taking the Icatl in this matter and on April i 
will hold at Rofiscvelt College a conference of some twenty-six 
independent fraternities which arc interested in a new national 
fraternitj based mion democratic principles. Our Faculty 
Constitution, student government, and all student clubs oper- 
ate on the basic jninciple tif ecjuality. 'Fhc result is well 
reflected by a statement which was spontaneou.sly made to a 
reporter of the Loutsviflc Courkr-'jfoiirnti/ when he interviewed 
a member of our b'.iculty upon die occasion of the recent in- 
auguration of Pre.sident Taylor at the University of Louisville. 
Our faculty member made this statement: 

At Roosevelt College there is a feeling of living in a free 
world which can be nvatched in few schools in this or any other 
country, as far ,as I know them . This does not mean that every 
faculty member and every .student is lilxjral, tolerant, or a near- 
god, But there is no .sense of fc.ar. There i.s assurance that 
your colleagues who clilFer with you also respect you as an indi- 
vidual and as a fellow citizen. Students, too. differ with each 
other and with .some of us from time to time. But freedom 
from fear i.s here, and freedom of speech is here, and freedom of 
a.ssembly is here.^ 

The problem of di.scrimination is, of cour.se, not exclusively 
the product of undemocratic administrative control in our 
schools, It arises out of the many complexities of the American 

^ I.auimlk Coiwifr-Jonnia/, February ji, 1948. 
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social order. It is no longer questioned that a serious degree of 
racial and religious discrimination does exist in our schools. 
The evidence is now in. Most of us are sorry and ashamed at 
the picture which the evidence reveals. A large part of Amer- 
ican educational practice stands convicted before the bar of 
democratic justice. The evidence shows that discriminatory 
practices are particularly vicious in the graduate schools of our 
colleges and universities, For example, in 1925, of all the 
graduates of the City College of New York who applied for 
admission to medical schools, 58.4 per cent were admitted. In 
1943 this figure had fallen to 15 per cent.'* 

A recent study reveals that the greatest discrimination 
against minority groups occurs in the fields of dentistry, medi- 
cine, pharmacy, law, business administration, fine arts, archi- 
tecture, veteiinaiy medicine, and forestry. Minority groups 
are holding their own in the fields of social work, journalism, 
engineering, and home economics. Minority group repre- 
sentation has somewhat increased in the fields of osteopathy, 
music, theology, library science, education, military science, 
and nursing. Tlie greatest discrimination at present seems to 
be in the professional law schools (where Jewish enrollment fell 
from 26% in 1935 to 10% in 1946).® 

In 1945 when Roosevelt College was founded, two funda- 
mental principles were stated in the Charter. 

1 . To provide a teacliing faculty for such college which shall 
be both free and responsible in the discovery and dissemination 
of truth ; and 

2. To provide educational opportunities to persons of both 
sexes and of the various races on equal terms. 

Today we have a great interracial student body of 5600. 
We do not know how many of what specific races we have repre- 
sented because we do not count oui students that way This is 
a great step toward the achievement of a greater democracy in 
American higher education. 

In many sections of the United States the problem of dis- 
crimination is primarily a political or legislative one. The 

^ Kingdom, Frank. "Discrimination in Medical Colleges.” The Jme^icanMet- 
October, 1945, p 4. 

® Baer, Max F. "Counting the Jewish College Students” National Jewish 
Weekly, November li, 1947. 
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clcarchf cxainple of thLs is, nf course, the laws of most southern 
slates which outlaw equal opportunity. The legality of this 
barrier has recently been tested in the .Supreme Court of the 
United States. ’I'his was the well-publicized Oklahoma case. 
7 ’hc Supreme Court ruled tliat states mu.st provide equal edu- 
cational n[ipnrtiinity for Negroes and whites. However, the 
now famous phrase “separate and equal” did not solve the basic 
problem bccau.se in a subsequent ruling the Court stated that 
.separate and equal tlid not mean “identical.” Thus, at the 
moment the in.attcr of segregation of the races in southern 
school.s is .substantially where it wa.s before the suit began. The 
results of such a system are also reflected in the amount of 
money which is .spent in these .state.s on white and Negro edu- 
cation. For example, in the District of Columbia three dollars 
arc .spent for white in.stimtion.s for every one dollar spent for 
comparable Negro in.stitutions, and in Kentucky this ratio rises 
alarmingly: In that .State, $42 are spent for white institutions 
for every $i spent for comparable Negro institutions,* 

One avenue of attack on the problem of discrimination was 
the recent pas'sage by the New York .State Legislature of a bill 
outlawing racial and rcligiou.s discrimination in the admission 
of students to private cnllcgc.s, universities, and professional 
schools.’ The principle of legal coercion to end discrimination 
was opposed by the American Association of Colleges meeting 
in Cincinnati in January of this year. The reasoning of the 
college presidents who met in Cincinnati was that such legis- 
lation as was then being considered in New York would give the 
State an undue influence in the affairs of the schools. Instead, 
the American Association of Colleges felt that schools should 
voluntarily eliminate the undemocratic practices of discrimi- 
nation in their admissions policies. Needless to say, I favor the 
stand taken by the State of New' York, and I opposed the stand 
taken by the majority of the members of the American Associ- 
ation of Colleges. It seems to me that Roosevelt College three 
years ago and now the State of New York have taken the only 
possible stand for those who believe in tlte practice of 

* "Eqimliiing and Expanding Individual Opportunity." High^ EJueali^ /or 
JmerUan Dtmocracy. Vol, II, Report of the President’s Commission on Higher 
Education. Washington: U. S. Government Printing Office, 1947, p. 3t. 

’ New York Times, March 14, 1948, p. 57. 
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democracy. This stand is to abolish all admissions quotas 
based on race and creed in determining who shall be educated 
in our schools. 

T/jf Problem oj Inequality of Achievement 

Commenting on the report of the President’s Commission on 
Higher Education, the President of Fordham University 
recently stated: 

By multiplying college facilities until they can care for every 
high school graduate who doesn’t want to go to work, the Com- 
mission is not doing the colleges or the country any favor. 
How the Commission hopes to multiply the sheepskins and 
have fewer sheep, I cannot guess. This program threatens to 
suffocate us with tides of mediocrity." 

Although I do not agree with President Gannon, it would be 
less than honest to suggest that schools which aim at an edu- 
cation for the masses in large urban areas are free from worries 
about the "tides of mediocrity” which flow to the doorstep. 

The special problems of minority groups in our schools are 
related to the general educational problem of discovering poten- 
tial abilities and training them. Educational administrators in 
an institution such as ours must be especially alert to the possi- 
bility that poor socio-economic environment may have covered 
up potential abilities. VVe must also be aware that some de- 
ficiencies can be eliminated by special training while others 
cannot Finally, we must also ask ourselves whether or not 
inequalities of achievement are due to any special character- 
istics of the various minority groups in our student body. Two 
complementary ways of dealing with the problem of unequal 
achievement have been initiated at our school, The first is the 
initiation of an Abilities Research Program, and secondly, the 
establishment of strong remedial programs in the fields of read- 
ing, writing and arithmetic. 

The Abilities Research Program has been initiated with the 
help of Science Research Associates of Chicago. Lyle Spencer, 
the President of this organization is on the Board of Trustees of 
the College, Our Abilities Research Project has succeeded in 

® Very Reverend Robert I. Gannonj President of Fordham University, as quoted 
in Tme MagaztnCf February 23, 1948. 
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intcrvhtinif sniiie at' tiu* outstaniliny leaders in the field of testing 
and nicasurement of human heliavior. Such authorities as 
Kuder, Tluirsfone, Warner and Kinsey arc assisting us in the 
Abilities Research Program. Wc have raken a sample of some 
4n'3studenl.s and have given them a battery of 36 different tests. 
Some of the, sc te.sts, such as .some designed by Thurstone, have 
not been given elsewhere and were e.sj)ccially de.signed for this 
jsrogram, as wa.s a .special device created by Warner for the 
establishment of sociti economic clas.sification. Our immediate 
problem is to find out whether we can, through this compre- 
hensive testing program, predict with any degree of certainty 
how well our students will do in college. Our student body 
represents a wider range of abilitie.s than is generally found in a 
four-year college, and our large number of minority group 
students gives us an unparalleled opportunity to discover 
whether or not these minority groups have special remedial 
problems. We have just begun to correlate the results of the 
testing with the course grades obtained by the te.st subjects m 
their regular academic courses. Thus, we arc not, at this time, 
able to rejiort any significant conclusions. (Xir program to date 
has, however, itulicateil that wc can jirofitably pursue further 
investigation baaed on the following hypotheses: 

1. Potentiality (possibility of growth within the limits im- 
posed by hereditary factors) i.s not distributed according to color 
lines, racial make-up, national boundaries or socio-economic 
class. 

2. It is po.s.sible through research to discover those poten- 
tialities that are trainat)le and those that are relatively untrain- 
able. 

3. If an Individual has a high proportion of both trainable 
and relatively imtrainablc ability-traits, then he is an excellent 
risk for college training regardless of previous achievement. 

4. If an individual has a liigh proportion of untrainable 
ability-traits but a low proportion of trainable ability-traits, 
he is still a good college risk if a sjsecial effort is made through 
remedial programs to bridge the gap between achievement 
record and achievement j)otential. It is in this category that 
we find many of our minority group problems, 

As to whether or not there are special problems among mi- 
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nority groups we are not yet in a position to say. Our own 
experience in the field of the interrelation of environment and 
intelligence is that theie is no scientific evidence which would 
prove that minority group members, such as Negroes, are less 
able to profit by a college education than white students. This 
view is substantiated by Dr. George Stoddard who has declared: 

Perhaps all that present clay intelligence testing can do in 
connection with the racial problem has been done: It has re- 
vealed no basis in scholastic aptitude for discrimination against 
any race or nationality present in the American population.® 

It has been stated that members of minority groups tend to 
lack social know-how and are often unfamiliar with the handling 
of highly verbalized and abstract material. Sometimes this 
has led to premature assumptions concerning the nature of 
intelligence. At other times this has caused many educators 
to group members of minorities into types and special groups. 
A recent study by the American Council on Education indicates 
that this typing and grouping has had an unfortunate reper- 
cussion in the writing of American’s textbooks for the elemen- 
tary and secondary level. This study came up with the follow- 
ing conclusions concerning the treatment of minority group 
problems in the text material of our schools:^® 

I. Intentional bias was not found in American teaching 
materials, but frequent value judgments and implications are 
often unconsciously or carelessly expressed; and even more pro- 
nounced, there are omissions of data and gaps in curiiculum 
planning which result in failure of the teaching outlines and 
materials to come to grips with the issues especially connected 
with the problem of minority groups in our population. 

a. The dignity and the worth of the individual are not 
stressed in most texts. The individual is usually submerged 
into a group; there is not adequate attention paid to the nature 
and value of human personali ty yier se. 

3. In treating group organization, too much emphasis is 
placed on “typical” group members such as Jew, Catholic, 

’ Stoddard, George The Meaning of Intelligence. New York; McMillan Com- 
pany, 1944, p, 247. i-j 

In The Educational Record, published by the American Council on Education in 
Washington, D. C , July, 1947, pp 235-262 
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Ncgnt, etc., and too little on the variety of individuals within 
group.s. 

4. Regarding the treatment of Jews, mo.sr of the U. S. text 
materials deal with information concerning ancient Jews before 
79 A.D., and treat these pctiple as if they hatl never changed. 
Many inaccuracies were also discovered in the description of 
Jews as "race"; tlvcrc was very little recognition of religious, 
ecoimmic and cultural variation among Jew.s. 

5. In treating immigrant.s, too much emphasis was placed on 
"out-groups" and there was too mucli over-simplification in 
referring to "new” (meaning after ifiHo) immigrants as alarming 
"hordes" or "swarms." Those latter groups of immigrants 
were usually referred to as “prohlems.” 

6. In treating Negroes, scientific data about race were con- 
spicuous by their absence. Very often the treatment of Negroes 
was on a “folkkire" level. 

It is easy to see how such text materials, circulating in our 
public schools today, do harm in connection with the problem 
of minority groups. Thus, a vicious and undemocratic cycle 
is maintained: Individuals are viewed a.s types, treated in text 
material a.s types and are studied as types rather than individ- 
uals. Ac Roosevelt College wc treat everyone a.s an individual 
and not as a type or mcml)er of any special race, 7 'his philos- 
ophy has enabled us to eliminate completely the tensions which 
exist in some interracial schools. In a recent survey, one of our 
graduates rather neatly summed up the results of our experience 
by declaring, "I shall always look back with justifiable pride 
upon this fraternal association of tlie races of mankind upon 
the common ground of learning." 

'The Problem of Restricted Opportunity m Job Placement 

Any school which concerns itself with the training of large 
numbers of minority group members will sooner or later dis- 
cover, us we have, that minority group members need more- 
than-average development of skills if they arc to be placed in 
jobs which are commensurate with their abilities. Our job 
placement experience to date .shows that wc do great service to 
minority group students by urging them to attain more varieties 
of skills than they might normally be expected to need. We 
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have counseled with them to add such skills as accounting, 
statistics, psychometrics, and typing even when these subjects 
are not tlieir major interests. Very often these extra skills 
have been the factors which tip the scale in favor of a minority 
group member applying for a position with a borderline firm. 
One practical result has been our success in introducing Negroes 
into higher grade positions in those firms already employing 
Negroes in menial jobs. 

Chicago is a crucial area in the development of principles of 
fair employment practice, and we believe that Roosevelt Col- 
lege is in a unique position to contribute to the establishment 
of such principles. Although we receive and train students 
freely, without regard to race or creed, it is inevitable that we 
would find that the business and industrial world does not act 
so freely and fairly in accepting minority group members for 
job placement, In a survey of a couple of hundred firms in 
Chicago, we found that only 2,9 per cent would accept the best 
qualified person for the job regardless of race, color or creed. 
The problem is general but we feel that our position in the 
community is unique and our approach is unusually effective. 

We reject the negative approach of trying to use coercion on 
prospective employers. Our approach is to talk things over 
with key business and industrial personnel leaders, try to dis- 
cover and to overcome problems of well-meaning employers, 
and to counsel intelligently with minority group members 
regarding their own adjustment problems and the key impor- 
tance of their own job performance when and if they enter a firm 
with a non-discriminatory policy. We believe this is a con- 
structive approach. Our immediate problem is to enlarge our 
activities in this field so that results can be followed up sys- 
tematically and valuable data thus obtained for contributing 
to the development of principles of fair and intelligent employ- 
ment practice. We have followed the practice of guaranteeing 
our recommended candidates and have enjoyed some success 
in convincing business, especially in the wholesale and industrial 
field, that a well-trained member of a minority group is a better 
personnel investment that a less capable native white 
American. 
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I liavc pointed nut u li.it can he done in three .s()ccific areas to 
promote greater demotracy in higher education. It is axio- 
matic that colleges cannot transmit that which they do not 
po.ssc.sK. Titcy cannot train young people for democratic 
living unless Boards of Trustees, Adtninistrators, Faculties 
and stiulcnt hrxlic.s live and act democratically. Colleges and 
universities must take .seriously their high mi.ssion of providing 
democratic lcader.shi|t for the stiengthening and perfecting of 
our great country to the eiul that “government of the people, 
by the people and for the people .shall not perish from the 
earth.” 



WHO SHOULD ATLEND OUR COLLEGES 

HILDA DAVIS 

Dc.in of Women, I'allndega College 

Today we are considering the question of members of the 
so-called ethnic minority groups in our school populations. 
The work “ethnic” is used in the sense of “pertaining to groups 
of mankind distinguished by common customs and charac- 
teristics.” To have said simply “minority groups” would 
have been to invite the possibility of too many interpretations, 
for there are many kinds of minorities if one uses the dictionary 
meaning for “minority,” “the smaller in number of two ag- 
gregates.” 

Wallace Spegner in his book One Nation identifies as “the 
unaccepted” in American life, Filipinos, Japanese-Americans, 
Chinese, Mexicans (or Latin-Americans as they are called in 
some parts of the country), the American Indians, Negroes, 
Jews, Catholics.' In as much as another session is to be de- 
voted to a consideration of intercultural relations, it seemed 
wise to omit from the present discussion the problems of 
minorities of various origins. In many schools the Catholics 
are definitely not in the minority, nor are they easily identified. 
Of Spegner’s minorities we have left for consideration the 
American Indians, Negroes, and Jews. The American Indians, 
of whom there were 377,000 in the United States in 1943, are 
confined on various reservations and only occasionally are mem- 
bers of this group found in schools and colleges other than those 
operated especially for them. It appears, then, that Jews and 
Negroes are the groups which claim our attention particularly, 
since their youth comprise the largest number of ethnic repre- 
sentatives to be reckoned with in our educational systems. 

The question of the acceptance of minority groups into the 
colleges of the nation is one fraught with high emotional tension, 

'Spegner, Wallace. One N/Hion, Boston: Houghton Mifflin Company, i 945 ' 
Chapter 7, p 141. 
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particularly in icgartl to the* acceptance of Negroes. Consider 
the vitriolic editorials appe^aring in new.spapers in certain 
.states following the recent Supreme Court tiecision in the case 
of Ada Fislicr vcrsu.s the State of Oklahoma and the report of 
the President’s Comntission on Higher Kducadon. The 
meeting of the governors af nine state.s to consider a regional 
university for Negroes, the various plans being devised and 
practi.scd in several .states to provide "sepaiatc but equal” 
educational facilities for Ncgrws, also arc not so “mute evi- 
dence" of the concern of many people in the matter. In other 
state.s where the exclusion of Negroes from the schools is not 
accomplished by law it is effected by such means as quota 
systems or the excuse of capacity enrollments already accepted, 
no matter at what time of the year a Negro applies. Even in 
states with a Bill of Right.s, such as Ohio and Illinois, one finds 
private schoohs whose announcements carry such a statement 
as “We regret that Ihtder The Academy’s rules, negro students 
cannot be accepted."* 

I'hc situation in regard to Jews is much more subtly handled, 
Quota .systems operate without being announced. The result 
is that colleges and schools which do not use such methods 
find themselves almo.st segregated schools, .so heavily Jewish 
is their enrollment; for example, City College of New York, 
about 90 per cent of whose students are Jewi.sh. 

I assume that the members of the Program Committee in 
asking me to participate in this session knew my attitude on the 
subject. It is my firm conviction that our enrollments in both 
public and private colleges should comprise representatives of 
all groups; that students should be chosen on the basis of their 
native endowment, their academic preparation, their ability 
to profit by the type of education available at a particular 
institution, and not on the basis of their race, color, creed, or 
family background. I believe that having accepted students 
on this basis an institution should grant to all students the 
opportunity of participating freely in any of the activities 
provided and of using all of the facilities without restrictions 
based on race, To educate our students to function adequately 
as citizens of our society our schools must make it possible 

* The Chicago Academy of Pine Arts. Bulletin, 1947, p. a'?. 
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for the youth of the nation to know each other in such a way 
as can come only through constant cooperation and participa- 
tion in activities of real and mutual interest. 

I am fully aware that my convictions are far from being 
reali2ed in various parts of the country, not just m the South 
and Southwest where state laws have operated to keep separate 
Negroes and Caucasians, and sentiment to exclude Jews from 
the schools. At the same time, my further remarks have 
pertinence, I believe, even for those persons who at present 
have no members of ethnic minorities in their colleges. The 
problems facing members of ethnic minority groups are much 
the same as those of any other minorities in an inclusive 
student population. 

In as much as the personnel officers of a college are usually the 
group who come most directly in contact with all of the students 
and frequently have the deciding voice in many matters in- 
volving members of minority groups, first of all college ad- 
ministrators, deans, counselors, or whatever the title, must 
examine their attitudes; they must look squarely at their own 
stereotypes and prejudices. Do we believe that all Negroes 
steal; that Negroes are untidy and dirty; that they are immoral; 
that they are mean and treacherous; that they lack the capacity 
to do high-level academic work; that most Negroes have 
syphilis; that all Negroes can sing; that Negroes are childish, 
light-hearted, and perpetually cheerful; that Negroes, as the 
saying goes, "would rather be with their own kind?” How 
many of us have accepted the prevailing stereotypes regarding 
Jews.'’ Do we think of Jews as clannish, unfair and addicted 
to cheating especially in money matters, as so aggressive that 
to advance their own interests they ruthlessly override others, 
as unclean and unkept in their persons and premises.'’ Un- 
doubtedly some of these accusations are true about some Jews 
and some Negroes, but so are they true about some Caucasians. 
The reverse is also true of some Jews and some Negroes. There 
are many members of these ethnic minorities who are meticu- 
lously clean, who are governed by high ethical and moral 
standards; many who have demonstrated their capacity for 
intellectual achievement on a level far beyond the under- 
standing of the average one of us; many who are affable, loyal, 
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generous and thoughdul ot other.s. Are we guilty of generaliz- 
ing from tof) few cases? It is unfortunate that we have made 
for ourselves nifnlels for Jews and Negroes. We have taken 
characteristics of incliviiluals and have constructed from these 
trait.s types which wc call the Negro and the Jew. Now, as we 
face the problem of further integration of minorities into the 
various aspects of American Hfe and more immediately into 
the American colleges, wc mu.st rid ourselves of the fallacious 
tendency to type people and to react to them as groups. 
Rather, we must seek to know and to evaluate them as in- 
dividuals. William Lloyd Imes in writing the "Role of The 
Christian College" made the statement, 

It IS quite the logic of things to begin by bating a man for one 
thing and to end up by hnding many other things wliich make 
u.s dislike both that man and others, too. Hatreds never run 
singly; they go in devilish and deadly packs. And racism i.s- 
easily pulled into the pack of luiman enemies wliich arc created 
by an evil and .selfishly coniiKtitivc order.® 

'rhe role of the administrator and the counselor is an im- 
portant one Frec[uently the final decision as to whether 
there shall be members of minority groups among the students 
in a college or how far they may partieijmte m college activities 
rests with the President, the Dean, the Dean of Women, the 
Resident Head. During the twenty years in which I have 
worked in the Deep South time after time I have shared with 
both Negro and white students the fnistratlon they have 
experienced when a dean of women or a college president 
forbade the participation of white students in some interracial 
activity. 

That the decision was that of one individual is demonstrated 
by a case in point. The daughter of one of my friends was a 
member of the liome Economics Department of a publicly 
supported university in a state which has a Bill of Rights. 
As this student was an out-of-state student, she was not 
familiar with the conditions prevailing in the Practice House 
of the Home Economics Department. Unwittingly then, she 
registered for this required part of the curriculum. Later 
she discovered that thi.s requirement was modified for Negro 

’Nelson, William Stuart, editor. The ChiiSlian ft'ny in Race Relations. New 
York; Harper and Brothers, 1948, p. 
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students. Imagine her astonishment and chagrin to find 
herself the only student living in one side of a double house 
while the teacher and some nine or ten white students lived 
in the other side. I was told that for the required number of 
weeks this student, living alone, went through the motions of 
cooperative living. She would be invited to dinner in the other 
side of the house occasionally; then the head of the Practice 
Plouse would help the Negro girl to prepare a dinner to which 
the white students were invited. When this student’s family 
protested, the President said in eflPect that he would not require 
any white students to live with Negroes. The only point in 
citing this case is to indicate that as individuals we frequently 
make decisions on the basis of our prejudices and impute these 
decisions to student desires. 

No longer can we evade the issue with the statement, “The 
students are not ready for this.” Early in September, 1947, 
about 800 students from colleges throughout the United States, 
among whom were many representatives of southern colleges, 
organized and formally adopted a constitution from which I 
quote a portion of the preamble, 

We, the students of the United States of America, desiring to 
maintain academic freedom and student rights, to stimulate 
and improve democratic student governments, to develop 
better educational standards, facilities, and teaching methods, 
to improve student cultural, social, and physical welfare, to 
promote international understanding and fellowship, to 
guarantee to all people, because of their inherent dignity as 
individuals, equal rights and possibilities for primary, second- 
ary, and higher education regardless of sex, race, religion, politi- 
cal belief or economic circumstances ... do hereby establish 
this constitution to the United States National Student 
Association.'' 

Another large group of American students assembled as the 
United Student Christian Council adopted the following 
Resolution on Racism, a part of which I quote. 

We have been confronted, at this Fourth Annual U.S.C.C. 
meeting, with a broken world desperately groping for a way of 
life which can assure peace and hope, . . . 

Racism is a cancer that eats deep into oui democracy, the 
Christian Church and even our own student fellowship It 


* Radcltffe Re-News. Cambridge, Mass., February, 1948, p a 
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cuc-< .ici'os:. cultuie, imiividiuK ami dims the Christian 

witne'.s. In fills festering sore in the very heart of what we 
try t<i do as C'luisti.uis, the Xegro in our life is hurt, frustrated 
and wtiundei! rind flie stivds of all citizens are blighted by this 
disease uf onr soci.d order. Worst of all, the witne.ss of the 
Christian Chvircli is weakened iKwause the racism breaks its 
fellowship and thus the Church itself makes explicit the 
negation tif Christian hrothciluMMl. The problem of racism 
within the t hurrh m our n.ititm is- not sec tional. It is a corpo- 
rate guilt of all the Church m all parts of the nation. 

Among the resolution,*! accepted with the above statement 
was 


We call upon each niemlier of U.S.C.C. lo urge hi.s national 
student Christian movement within the coming year to make 
one of its major program eniphasc.s that of improving race 
relations.* 

To come even nearer the problem-- ten years ago the Uni- 
versity of Mis.souri .students voted in large numbers for the 
admission of a Negro, Lloyd Crainc.s, to that institution. More 
recently a majority of the students at the University of Okla- 
homa vfited for the atimis.sion of Ada Fisher to the University 
of Oklahoma law school. In .Auburn, Alabama, the students 
were polled on their attitude towartl the admission of Negro 
students to the state-supported iwlytechnic institution located 
in that city. Twenty-eight per cent of the students expressed 
themselves in favor of admitting Negroes and eleven per cent 
as indifferent. While the larger number voting in this instance 
expressed a negative attitude, we must recognize that students 
are becoming concerned about the problem and are developing 
attitudes against the exclusion of members of minority groups. 

I can not emphasize too much the importance of an objective 
attitude toward members of minority groups held by deans and 
counselors, and to that end 1 would urge that tltey avail them- 
selves of opportunities to know members of the various ethnic 
groups individually. Courses and institutes concerned with 
human relatioiEs and more specifically with intercultural rela- 
tions such as are being offered at Mills College, the University 
of Chicago, Harvard and Radcliffe Colleges, Yale University — 
to name just a few of them — would be valuable to deans and 

* Ftdcratkn News Sheet, Monthly Bulletin of the World's Student Chri-stian Fed- 
erarion, February, 1948, p. 5, 
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counselors in changing their points of view as they are faced 
with the problem of minority groups in the colleges. In a 
course in Behavior Problems several years ago Dr. Mandel 
Sherman frequently reiterated his belief that people do not 
change their attitudes until they have had different experiences 
from those which produced the attitudes which need changing. 
Before we try to guide immature students into constructive 
attitudes and behavior in regard to minority groups, we, 
ourselves must have wholesome attitudes and courage to face 
the various problems involved. 

The problems to be dealt with by deans and counselors con- 
cerned with ethnic minorities are those which are usually 
identified with the profession — vocational and educational 
counseling, housing, social and other extra-class activities, 
personal problems, and inter-personal relations generally, 
although these problems may be intensified when race is a 
factor. Educational and vocational counseling can scarcely 
be separated, for practically all students in colleges are looking 
toward some vocation after undergraduate- or graduate-school 
days. After the general educational level they choose courses 
which will move them toward their vocational goals. Too 
many times Jewish and Negro students even in high schools 
are steered into courses which fit the various counselors’ 
stereotypes of vocational opportunities for a particular ethnic 
group, rather than into courses which satisfy these students’ 
interests and abilities. For example, at the college at which I 
have worked for the past eleven years, year after year we have 
enrolled graduates of a high school in a certain large northern 
city. All of these students have been graduates of technical 
curricula rather than of the general liberal arts course. When 
we inquired into this circumstance because a number of these 
students of high intellectual ability showed evidences of 
personal maladjustment and faulty attitudes toward school 
work, we learned that the counselors in this high school, all of 
whom were white, invariably enrolled Negro students in the 
technical courses because they believed that the girls could 
find work only in home economics activities and the boys in 
mechanical trades. One of our graduates living in this city 
had believed that all of his seven children could not be identical 
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in .ihilitics .uni vrK.jt-Min.jl intfrcsts. He sent them and a 
numl^er of the chikh-cn of hi*, friends to his alma mater for ns 
to try t*) rorrcef the results af the faulty counseling which 
these ynung |w(tple h.ul received in high school. It is true 
that there are still a few tocational activities to which Negroes 
and Jews are dcnictl access and .stime others in which the par- 
ticipation of these ethnic grnup.s is .severely limited. In 
coun.scling Mich Htvulents the counselor .should of course point 
out the limit.itions, Inn he shouht not he too negative in his 
attitiulc towartl any vocation tow.ird which a .student aspires, 
provided the .student has ability ami the other factors which 
seem to predict success in that field. Who knows but that 
the very student now helm; counseled will he the first of his 
grouji to perform in a certain field? Negroes are now faced 
with numerou.s vocational opportunities heretofore closed to 
them and find that there is none of their group prepared to 
hold a certain position, not because no Negro ha.s the ability 
to do chat work successfully hut because no Negro has pre- 
pared to do it. 'rhe National Urban League and the Jewish 
Occupational Council have jHihiished materials which are 
useful in vocational counseling witli members of these ethnic 
groups. 

What of luni.sing? Is it better to house members of a par- 
ticular minority group together, i.e., in a separate building, 
in one wing or on one floor? Should roommates always be 
of the same ethnic group? My answer to both of these ques- 
tions is "No,” Very definitely, members of minority groups 
should not be separated from the other students. Such 
segregation arouses resentment .ind inferiority feelings in the 
minority group students. It also tends to increase the sus- 
picion ami lack of understanding of one group toward the 
other. Certainly there are some white students who do not 
want to associate with Negroes and/or Jews. The housing 
practices of a college should be made according to the aims and 
ideals of the college. Practically all colleges chum to be 
educating students for democratic living. The needs of the 
individual white students who are not sufficiently mature 
socially to live next door or across the hall from Negroes or 
Jews, for example, should be accepted by the dean or the 
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counselor and adjustments made in the individual cases. It 
should be possible to provide all white neighbors and room- 
mates for those who can not yet accept persons of a different 
ethnic group. 

Experience has shown that frequently persons who have 
thought their prejudices immovable have been thrown by 
unavoidable circumstances into contacts with members of 
ethnic minorities and liave found the experience not repulsive, 
as they had anticipated, but interesting and later even pleas- 
ant. During the years of my residence in International House 
and in several of the dormitories of the University of Chicago 
I have frequently been told by some of my associates who had 
not identified me racially of their anticipated reactions at the 
prospect of living with Negroes, eating at the same tables, 
using the same bathrooms and the like, and of their surprise 
that the actual contact had not affected them m the way they 
had anticipated. 

In this situation, as in most situations, the Counselor, the 
Resident Head, the Personnel Dean set the pace. One head 
resident I know used to invite one or two Negro girls to eat 
at her table each meal during the first days of the quarter and 
introduced them to other students. She made it possible 
for girls who had negative attitudes toward Negroes to discuss 
them frankly and without censure. The same rapport existed 
between her and the Negro girls. She recognized what many 
others do not, that the batde is only half won when white 
students change their attitudes toward minority groups. 
Sometimes an even more difficult part of the problem is to 
convince the members of ethnic minorities that the overtures 
of white persons are genuine expressions of respect, apprecia- 
tion, and acceptance. Too frequendy Negroes, especially, 
have been so deeply hurt by the frustrations and indignities 
which they have experienced at the hands of others because of 
race that they withdraw into themselves and actually repel 
the efforts of others to become acquainted with them. 

Members of ethnic minorities should not be excluded from 
activities as a matter of policy. At the same time, they should 
not be chosen for positions simply to have a group represented, 
even though the individuals available are not interested in the 
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activity or lack qualifications for the juirticular positions. A 
stratagem of pcrs(»ns who wish tf> tienionsrrate their prejudice 
regarding a Negro’s lack r.f intelligence is to put him in a 
pn.sition for which he is not fitted. His suksequent failure is 
then gcncraliml to ftthcr mcnihcr.s of his group. 

Of course, all stmlcnts .should he able to use all of the facilities 
of the institution, including the swimming pool. Several 
years ago one of my fellow deans of women told me that the 
Negro students in her college were nor permitted to use the 
swimming [>ool which the other students used by arrangement 
with a YWCA in her mid-western city because of the high 
rate of venereal disease among Ncgroe.s in that city, I have 
always wondercil why the health .service in her college was 
unable to determine which Negro students might be free of 
venereal di.seasc. 

What kind of camjnis jobs will be given students of the 
various ethnic groups? Should Negro students he appointed 
only to janitorial or domestic jobs or will they be given work 
opportunities commcn.sur.ite w-itb their skilLs and abilities? 
This aspect of a student’s functitnimg in a college is almost 
entirely in the hatuls of administrative ofiicers. 

Another problem which must be faced in considering the 
inclusion of minority groups in a student enrollment is the 
extent to which they shall participate .socially. If social 
activities are a valid part of the education of students, and we 
have long ago agreed that they arc, then all students must be 
free to participate In them. This area represents the one 
about which many people have the greatest anxiety. Will 
not interracial fellowshiji lead to fraternizing and love affairs? 
Marriage across racial lines is the “red herring” which is 
dragged into all cliscu-ssions of activities inclusive of minority 
groups, It is indeed the cool of the narrow-minded and the 
fearful. This is a ratltcr groundless fear. In colleges where 
members of ethnic minority groups attend and participate 
freely and normally in the activities there have been few if 
any cases of interracial marriage. Efforts to keep white 
youth from asfiociation with Negroes, for example, has height- 
ened for both Negroes and white youth the sense of glamor and 
air of adventure in mutual association. laist year during my 
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residence at the Chicago International House the social rela- 
tionships of Negro and white students were frequently dis- 
cussed. Several southern white women students who for the 
moment were “going with” Negroes, to use the student ver- 
nacular, said more than once, “I’ve never known Negroes 
before, but now I find that they are not at all like the stories 
I’ve been told. They’re just like anybody else.” When the 
novelty of the situation had worn off, these white students 
could accept Negroes as “just like anybody else” and not 
confine their attention to them. Guidance by a wise counselor 
can help young people to realistically wholesome social rela- 
tionships with members of other ethnic groups. 

Interpersonal relations are involved in all aspects of a 
student’s life m a college. If he must help to support himself, 
he is in contact with a supervisor and with other workers. In 
the dormitory obviously there are many persons with whom he 
must adjust. The responsibilities of counselors as well as other 
personnel workers may be greatest in this regard. If a student 
under emotional stress can talk to a counselor he trusts to 
listen without censure or praise to the expression of private 
and hostile attitudes, the student has made at least one step 
toward ridding himself of his negative attitudes. The thera- 
peutic process will be advanced if the counselor can clarify 
for the student the feelings being expressed and at the same 
time refrain from telling him how he should react or what the 
next steps are. No one but the student himself can really 
decide what is best for him-, although superior knowledge and 
experience may give a counselor insights which the student has 
not yet achieved. 

Opportunities for group discussion and face-to-face expres- 
sion of attitudes and concern will be of great service to members 
of ethnic minorities as well as to Caucasian students in our 
colleges. 

If I had taken a text for my remarks today, it would have 
been, “Physician, heal thyself.” I believe that the serious 
problems feared by those who hesitate now to have an in- 
clusive student group will not materialize if those who are 
responsible for the guidance of the students — and I include in 
this category faculty and staff from the president on — are 
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cammitrcd to the jMilicy of utTcpting persons as individuals 
and of providing (ippirniiiities fttr them in which they may 
develop according to their capacities and interests No 
matter how many students arc on a campus and how busy 
counselors and deans are, their attitudes toward minority 
groups stKin become kiunva. Ia*t each of us, then, examine 
our attitudes and dfi stirnething constructive toward developing 
an understanding of an appreciation for all people. Then we 
can disapprove of wliat .some imlividuals do,likesome members 
of a group and dislike othcr.s, understaiul why particular per- 
sons act as they d«. When we have achieved this level of 
emotional objectivity nur.selve.s, we can help our students 
to function more effectively in mir society which is unques- 
tionably a mixed one of ]yy.ooo Indians,* 4,50x0,000 Jews,' 
and nearly 14,000,000 Negroe.s to mention only groups in the 
United States not identiftcal .specifically with another nation, 

* SjtfRncr, Of. til., p. i4t. 
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PUTTING OCCUPATIONAL INFORMATION ACROSS^ 

ARTHUR H, BRAYFIELD 
Deun of Student Personnel, Long Beach City College 

In 1909, Frank Parsons devoted forty of the one hundred 
and sixty-five pages of his counseling classic, Choosing A Voca- 
tion, to the topic of occupational information under the general 
heading of "The Industrial Investigation.” Since that time 
practically all professional personnel workers have stressed the 
importance of such information in the counseling of both youth 
and adults. All of the standard texts in the field refer to the 
use of occupational information as an integral part of any 
student personnel program. Several authors have written 
extensive treatments of the topic, the most recent of which is 
Shartle’s book titled Occupational Information which I have 
elsewhere referred to as heralding “the coming of age of what 
Kitson has tentatively labeled for want of a better term the 
‘Science of Occupationology’.” 

Yet, despite this early recognition of the importance of 
occupational information in counseling and related personnel 
activities and its acceptance as one of the major tools of person- 
nel workers, one searches the literature almost in vain for 
any systematic consideration, on other than a techniques 
level, of the use of occupational information. Descriptions 
of specific media and materials abound, but discussions of 
basic principles underlying their application are conspicuous 
by their absence. 

Before we try to “put occupational information across” I 
believe that it is essential that we critically examine the cus- 
tomary uses of occupational information and attempt to 
formulate a few relevant principles to guide any discussion of 

^ Discussants whose comments are not recorded are Dwight A Stewart, Personnel 
Supervisor, Radio Corporation of America, Indianapolis; Barbara H Wnght, Senior 
Consultant in Counseling, Public Schools, Minneapolis, Max F. Baer, National Direc- 
tor, Vocational Service Bureau, B’nai B’nth, Washington, D C ; Margery E, Hoppin, 
Research Assistant, Western Personnel Institute, P.asadena 

485 



4^^) rni;rAl K)S At. ASIJ fSA'CHOUtCilOAI, MKAStSRnMENT 


specific techniques. The renniinticr nf my remarks are devoted 
to suc h an end. 

At the outset I slunild like to make two important distinc- 
tions. The first is one mculc hy (Jr.ice Munson and Lester 
Sfhloerli untinu m the recent A Biuit ‘/V,v/ for Guidance 
Markers, edited l>y Clifford Kriekson, wlicrein they differen- 
tiate hetween the exlcnshr and the intensive use of personnel 
materials loir example, the extensive u.se of occupational 
information materials means tliat “throughout all the years 
of the school life of the child, there shtnild he an effort to 
emphasize the real nature of the world of work.” However, 
they also point tnir that there arc certain elements which 
demurul concentrated study and activity often at a particular 
point in the snidcnt’s career, ami thi.s they term the intensive 
u,sc of such materials. In tlii.s paper 1 have considered only 
the intensive use tif occupational information. 

A aeconil necessary distinction is between the use of occupa- 
tional information in group instructional .situatioms and in in- 
dividual ctuin.sding. (Parenthetically the use of the word 
“individual" i.s redundant when asscKiatcd with the term "coun- 
seling" hut I shall use it for emphasis.) Both aspects are 
discuss‘ed in this paper. 

Group in.struction in occupational information as a part of a 
school program ordinarily is organized in one of three ways: 
(i) as a pervasive part of the "regular” curriculum; (%) as a 
special unit in standard school subjects such as English, 
Civic,s, etc.; or ( 3 ) as a course organized siieclfically for the 
purpo.se. My concern is with the latter form of organization 
only. 

The in.structional methods used in such courses may include 
such diverse techniques as lecture-discussion, textbook and 
other printed material study, outside speakers, motion pic- 
tures, cla.ssroom dramatizations, radio, special projects, careers 
booklets, and case studies. 

I should like to contrast two group instruction approaches 
now current, 'I'lie first is what 1 prefer to call the standard 
occupational injarmation approach (the term “standard" carries 
a less evaluative connotation than the term “traditional" which 
might well be substituted). This approach is associated with 
the names of such personnel workers as Brewer, Billings, 
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Forrester, and others. Its characteristics can be treated 
under the headings: point of view, subject matter, methods, 
assumptions, and evaluation. 

The basic point of view of this approach appears to be that 
the acquisition of information about the world of work is the 
proper starting place for vocational planning. 

The subject matter typically is concentrated upon occupa- 
tional information fer se with lesser emphasis upon psycho- 
logical materials. The following quotation from Billings in 
her Group Methods oj Studying Occupations is a clue to the 
relative emphasis. “There are a number of occupational 
considerations,’’ says Billings, “which should be treated 
briefly (italics by the present writer). Students should know 
that there are certain basic skills such as mechanical ability, 
clerical and commercial skill, verbal ability and others.” 
The Brewer and Landy text, Occupations ’Today, is perhaps 
representative. 

As to methodology, much of the work is classroom and text- 
book centered. Workbooks which stress the accumulation of 
occupational information are frequently used. A common 
device is the Careers booklet. With respect to the latter, I 
cannot refrain from commenting that my experience with col- 
lege freshmen has led me to formulate the concept of “voca- 
tional planning arrested in its development at the level of the 
ninth-grade Careers booklet” by which I mean that many 
entering freshmen have fixated upon vocational plans arrived 
at as a result of the apparently traumatic experience of writing 
up some vocational field in order to satisfy the requirements of 
a ninth-grade course in Occupations. Occasionally such 
plans have some slight degree of appropriateness for the 
individual concerned. 

Although I have found in the literature no formal rationale 
for the standard occupational information approach, I am 
inclined to believe that the following assumptions are at least 
implicit. 

I. The individual who has been formally exposed to occupa- 
tional information will make more appropriate voca- 
tional choices than the individual who has not been so 
exposed. 

2 The individual will make specific application of the con- 
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!cnt fif rlu’ « <nn>t‘ fo his nv\n siiuatimi with ci minimum of 
indiA'iduai assistant c 

'riu* indi\:dua! vMinj'lrtiny siuh n course will develop 
attitudes asui skills whish will carry over as new problems 
of vocational adjustment arise. 

None of these assumptifins lias hern tested. Tile evaluation 
td* this standard ajiproach has hecn lari'cly in term.s of the 
amounts of information which have hecn uained as a result of 
exposure I'hc typical experimental tlesijin i,s to rest an experl- 
ineiu.ll and a control urnup at the he^inninit of a course in 
Occupational Information with a test which .stre.sses occupa- 
tional information. At the end of ilie period of instruction 
both uroups are re-lrste«l. The iliHcrentiah of course, is the 
exposure of the memher.s of the experimental group of the 
course. The comparison, with the proper control for initial 
status, is then niatie hetween (he .status of the two groups on 
rc-tesling. 'I'he results have been conflicting. A .survey of 
studies hy such investiirator.s as Billings, Jessup, Hand, and 
Williamson leads to the cnnclu.sion that exposure may lead to 
the accumulation of more oicupatinnal information. The 
more adecpiatcly designed .studie.s do concur, however, in the 
finding that If you set out to teach occupational information, 
you will produce gains in the amount of .such information 
possessed hy the members of the instructed group. I leave to 
you the inter)irotation of the significance of this finding. 

The second major group instruction approach is what I 
prefer to call the sacio-psychological or what Munson and 
Schloerh of the Chicago Public .Schools term the self -appraisal 
and carem type of cour.se, 'I’hi.s approach is assocated with 
the work of NTniberg at Wittenberg College, Allen and Towne 
at Providence, the Chicago program, the work of the Min- 
nesota group including McLean, W’illiamson, Paterson and 
Hahn, and others including Margaret Bennett at Pasadena 
and the more recent develojuncnt at Philadelphia. 

The basic jioint of view of tliis approach is that the acquisi- 
tion of information about the self is the proper starting place 
for vocational planning. 

The subject matter of this approadt strikes a balance between 
the psychological study of the individual and the study of 
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occupational information. In contrast with Billings’ state- 
ment which recommended only brief attention to the study of 
individual characteristics, Munson and Schloerb state that 
“Every effort must be made, however, to show a well-planned 
distribution between self-appraisal study and career study.” 
Aptitude and interest patterns provide the scheme for the 
presentation of occupational information The printed ma- 
terials from the Chicago program are perhaps representative. 

As to methodology, the emphasis is upon using both the 
classroom and the community as important learning labora- 
tories. Projects involving considerable student initiative and 
activity are basic to a successful program. Rather than the 
standard Career booklet, the intensive case study becomes 
one of the important vehicles for translating the findings of 
the work of the course into meaningful materials to be applied 
to a given individual. The case study technique leads directly 
into the individual counseling which is considered the stne qua 
non of the whole approach. 

The following assumptions underlying this approach are 
interpretations primarily of the writings of the Providence and 
Chicago people and are based also on my own association with 
the program at Minnesota. 

I. The individual who has been formally exposed to the 
work of such a course will make more appropriate voca- 
tional choices than the individual who has not been so 
exposed. 

1. The number of individuals making appropriate vocational 
choices will increase as individual counseling is provided 
to supplement the group instruction. 

3. The individual completing such a course will develop 
attitudes and skills which will carry over as new problems 
of vocational adjustment arise. 

To my knowledge, there has been only one attempt to 
rigorously evaluate the socio-psychological approach, This 
is the study by Plarold Stone of the vocational orientation 
program in the General College of the University of Minnesota. 
Stone found, as had some of the evaluators of the standard 
occupational information approach, that students exposed 
formally to such information made greater gains in measured 
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committal to the policy of accepting persons as individuals 
and of prov’idiniK opportunities for them in which they may 
develcfp according to their capacities and interests. No 
matter how many students are cm a campus and how busy 
counselors anti cleans are. rlicir attitudes toward minority 
groups srwn become known, i.er each of us, then, examine 
our attitudes and do something constructive toward developing 
an understanding of an apjireciation for all people. Then we 
can disapprove of what .some individuals do, like some members 
of a group and dislike others, understaiul why particular per- 
sons act as tlicy do. When wc have acliicvcd this level of 
emotional objectivity ourselves, we can help our students 
to function mesre effectively in our societ)' which is unques- 
tionably a mixed one of 377,000 Indians,* 4,500,000 Jews,' 
and nearly i4,ooo,cxx) Negroes to mention only groups in the 
United States not identified .specifically witli another nation. 

•SiKTgnrr, e/>. cil., p. l4t, 

’ lliJ; p. lot. 
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In 1909, Frank Parsons devoted forty of the one hundred 
and sixty-five pages of his counseling classic, Choosing A Yoca- 
tion, to the topic of occupational information under the general 
heading of ‘The Industrial Investigation,” Since that time 
practically all professional personnel workers have stressed the 
importance of such information in the counseling of both youth 
and adults. All of the standard texts in the field refer to the 
use of occupational information as an integral part of any 
student personnel program. Several authors have written 
extensive treatments of the topic, the most recent of which is 
Shartle’s book titled Occupational Information which I have 
elsewhere referred to as heralding “the coming of age of what 
Kitson has tentatively labeled for want of a better term the 
‘Science of Occupationology’.” 

Yet, despite this early recognition of the importance of 
occupational information m counseling and related personnel 
activities and its acceptance as one of the major tools of person- 
nel workers, one searches the literature almost in vain for 
any systematic consideration, on other than a techniques 
level, of the use of occupational information. Descriptions 
of specific media and materials abound, but discussions of 
basic principles underlying their application are conspicuous 
by their absence. 

Before we try to “put occupational information across” I 
believe that it is essential that we critically examine the cus- 
tomary uses of occupational information and attempt to 
formulate a few relevant principles to guide any discussion of 


' Discussants wlwsc comments are not recorded are Dwght A. 

Supervisor, Radio Corporation of America, Indianapolis; Baniara H. Wngh , e 0 
Consultant in Counseling, Public Schools, Minnea.polis, Baer, National Di - 

tor, Vocational Service Bureau, B’nai B'nth, Washington, D, C ; Margery E H pp , 
Research Assistant, Western Personnel Institute, Pasadena, 
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Specific tccJiiiitpu’s The reniaintier of my remarks are devoted 
to such an end. 

At the niHscr I slmuKl like to make two important distinc- 
tions. The first is one m.uie hy (Trace Munson and Lester 
SchltHTh writinit in the recent .1 Jhtsic Text for Guidance 
Workers, edited hy (‘lifidrd Krickson, wherein they differen- 
ti.ite between the extensive and tlur intensive use of personnel 
materials. For example, the extensive u.se of occupational 
infortnation materials means that ’'throughout all the years 
of the .srhmti life iT the child, there should he an effort to 
emphasi/e the real nature of the world of work.” However, 
they also point out that there are certain elements which 
demand concentrated stiuly and activity often at a particular 
point in the .studeiu's career, and this tltey term the intensive 
use of such materials. In this paper I have considered only 
the intensive use of occupational information. 

A second nece.csary di.stinctittn is between the use of occupa- 
tional information in ^iroup instructional situations and in in- 
dividual counsdine. (Parenthetically the use of tl\e word 
“individuar’ is redundant when assrK'iaCctl with the term "coun- 
selinfi” but I shall use it for emphasis.) Both aspects arc 
di.scussecl In thi.s paper. 

Group in.stmction in ta-cupational information as a part of a 
school program nr<linarily i.s organized in one of three ways: 
(i) as a pervasive part of the "regular” curriculum; (2) as a 
special unit in standard schotil subjects such as English, 
Civics, etc.; or (3) as a course organized specifically for the 
purpose. My concern is with the latter form of organization 
only. 

The in.structional methods used in such courses may include 
such diverse technicpics as Iccture-discu.ssion, textbook and 
other printctl material study, outside speakers, motion pic- 
tures, cla.ssroom dramatizations, radio, special jwojects, careers 
booklets, and case studies. 

I should like to contrast two group instruction approaches 
now current. The first is what I prefer to call the standard 
occupational information approach (tlic term "standard" carries 
a less evaluative connotation than the term "traditional” which 
might well be substituted). This approach is associated with 
the names of such personnel workers as Brewer, Billings, 
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Forrester, and others. Its characteristics can be treated 
under the headings; point of view, subject matter, methods, 
assumptions, and evaluation. 

The basic point of view of this approach appears to be that 
the acquisition of information about the world of work is the 
proper starting place for vocational planning. 

The subject matter typically is concentrated upon occupa- 
tional information -per se with lesser emphasis upon psycho- 
logical materials. The following quotation from Billings in 
her Group Methods oj Studying Occupations is a clue to the 
relative emphasis. “There are a number of occupational 
considerations,” says Billings, “which should be treated 
briefly (italics by the present writer). Students should know 
that there are certain basic skills such as mechanical ability, 
clerical and commercial skill, verbal ability and others ” 
The Brewer and Landy text, Occupations Today, is perhaps 
representative. 

As to methodology, much of the work is classroom and text- 
book centered. Workbooks which stress the accumulation of 
occupational information are frequently used. A common 
device is the Careers booklet. With respect to the latter, I 
cannot refrain from commenting that my experience with col- 
lege freshmen has led me to formulate the concept of “voca- 
tional planning arrested in its development at the level of the 
ninth-grade Careers booklet” by which I mean that many 
entering freshmen have fixated upon vocational plans arrived 
at as a result of the apparently traumatic experience of writing 
up some vocational field in order to satisfy the requirements of 
a ninth-grade course in Occupations. Occasionally such 
plans have some slight degree of appropriateness for the 
individual concerned. 

Although I have found in the literature no formal rationale 
for the standard occupational information approach, I am 
inclined to believe that the following assumptions are at least 
implicit. 

I. The individual who has been formally exposed to occupa- 
tional information will make more appropriate voca- 
tional choices than the individual who has not been so 
exposed. 

a. The individual will make specific application of the con- 
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lent (<l the rnur-'i* tn his ttwn sjfiuiiifin with a minimum of 
:ndi^ idu.iil .issisj.siu c 

Thr jjiirivhhi.i! I umi'lrfmu suvh a tour.se will develop 
affuutics anil skills whiih will carry (iver as new problems 
f d’ voca tinital adjusfmenr arise. 

None of diesr assunijuinns has been tested. The evaluation 
of this stamiard appio.uh has been largely in terms of the 
amounts ttf informafion whhh have been i*ainc<l as a result of 
eiiiposure 'I'he typiial experimental design is tt) test an experi- 
mciUid ami a rontrtd unuip at the beginning of a course in 
Occupational Information with a test which stresses occupa- 
fitma! information. At the end of the period of instruction 
both groups arc rc tested, 'I'he difi'crcntial. of course, is the 
exposure of the members of the exjterimental group of the 
course. The noinpanMUi, with the prfjper control for initial 
.stalu.s, is then made hetween the status of the two groups on 
rc- testing. The results have been conflicting, .A survey of 
studies by .such investigators as Billings, Jessup. Mand, and 
Williuitison leatls to the conclusion that exposure may lead to 
the accumulation of more occupational information, The 
more atlequatcly dcsigncil studies do concur, how'cvcr, in the 
finding that if you set out to teach ttceupation.il information, 
you will prtuluce gains in the amount of such information 
jKJSscssed by the members of the instructed group. I leave to 
you the interpretation of the significance of thi.s finding. 

The second major group instrviction approach is what I 
jirefer to call the socio-psychoh^ical or wltat Munson and 
Schloerb of the Chicago Public Schools term the self-appraisal 
and careers type of course. This approach is assocated with 
the work ofNeuberg at Wittenberg College, Allen and 'Powne 
at Providence, the Chicago program, the work of the Min- 
nesota group including McLean, Williamson, Paterson and 
Ilahn, and others including Margaret Bennett at Pasadena 
and the more recent development at Philadelphia. 

The basic point of view of this approach is cliat the acquisi- 
tion of information about the self is the proper starting place 
for vocational planning. 

The subject matter of this approacli strikes a balance between 
the psychological study of the individual and the study of 
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occupational information In contrast with Billings’ state- 
ment which recommended only brief attention to the study of 
individual characteristics, Munson and Schloerb state that 
‘‘Every effort must be made, however, to show a well-planned 
distribution between self-appraisal study and career study.” 
Aptitude and interest patterns provide the scheme for the 
presentation of occupational information. The printed ma- 
terials from the Chicago program are perhaps representative, 

As to methodology, the emphasis is upon using both the 
classroom and the community as important learning labora- 
tories. Projects involving considerable student initiative and 
activity are basic to a successful program. Rather than the 
standard Career booklet, the intensive case study becomes 
one of the important vehicles for translating the findings of 
the work of the course into meaningful materials to be applied 
to a given individual. The case study technique leads directly 
into the individual counseling which is considered the sine qua 
non of the whole approach. 

The following assumptions underlying this approach are 
interpretations primarily of the writings of the Providence and 
Chicago people and are based also on my own association with 
the program at Minnesota. 

1. The individual who has been formally exposed to the 
work of such a course will make more appropriate voca- 
tional clioiccs than the individual who has not been so 
exposed. 

2. The number of individuals making appiopriate vocational 
choices will increase as individual counseling is provided 
to supplement the group instruction 

3. The individual completing such a course will develop 
attitudes and skills which will carry over as new problems 
of vocational adjustment arise. 

To my knowledge, there has been only one attempt to 
rigorously evaluate the socio-psychological approach, This 
is the study by I-Iarold Stone of the vocational orientation 
program in the General College of the University of Minnesota. 
Stone found, as had some of the evaluators of the standard 
occupational information approach, that students exposed 
formally to such information made greater gains in measured 
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kfimv!ei,l;»r rh.ui di*! a fnnrrrd I'roup. He found also that work 
in the i'tiuf.*«c pn^luccd a *>bik in v^jcational aspirations bringing 
them mvKh nuirr in imr with reasonahk expectation than was 
tnic for Jiis tfinfrnl itrfnip 

Stfine's ftve.r im[»ur!ant finding, lufWev-er, had to do with the 
cffctt (if {•nrnllmrnt in the course uj«>n the appropriateness of 
whuatinnahvfvrational pitals;. rsing this criterion of effec- 
fivcncss, he discovered that both the control and the experi- 
mental group hat! lower pro{K»rtittns of optimal choices and 
higher projHjrtions of j^Kir cluticcs at the end of the study. 
Thus the effect ttf the course appcarctl to he more disrupting 
than helpful. Thiu tvcems to negate the first assumption. 

However, and this is an extremely .significant finding for 
personnel workei.s, when he compared a group of counseled 
student.s who had had the vtKMtionai orientation course with a 
group of counseled students who had not had the course, he 
found that the former group made significantly greater changes 
in the direction of approjmiatc choices than did the counseled 
group which had nor hat! the vocational orientation back- 
ground. I interpret this w mean that the values of this 
approach arc mtirc likely ttt he realized tc/ien the gi'oup instruc- 
thmi prograjrt is ttccnmpameti l>y imiimdual counseling and, 
conversely, that counseling i.s likely to he most effective when 
group instruction has laid the necessary foundation. 

It should he obvious that we lack sufficiently final evaluative 
data for either approach to he able to make definitive state- 
ments of basic principles. However, to express a personal 
point of view, I would postulate the following as guides to the 
use of occupational information per se in group instructional 
programs; 

I. The emphasis .should be distributed relatively evenly 
between psychological and occupational materials. 

a. Study of the self should precede study of occupations. 

3. Sj)ecific occupational information should be organized 
around aptitude and interest patterns rather than around 
traditional classifications such us the Census and the 
Dictionary of Occupational Titles. 

4. Except for a brief overview of the entire world of work 
the occupational fields selected for group study should be 
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chosen with due respect not only to the expressed in- 
terests of the members of the group but particularly with 
reference to the types of occupations likely to be followed 
by the majority of the members of the group. 

5. Each member of the group should review his work in the 
course with a trained counselor. 

In essence, then, I am urging strongly that we abandon the 
standard approach to the use of occupational information in 
group instructional programs. I urge that we concentrate 
instead upon the development of more adequate forms of 
organization of group instruction which will integrate socio- 
psycliological materials. Further, let us insure that individual 
counseling is a concomitant part of our group instructional 
program. 

Turning now to the use of occupational information in 
individual counseling I find the literature sadly lacking in any 
systematic treatment of the topic. Rather characteristic is 
the mention, in a recent text, of “disseminating” occupational 
information to individuals. This lack of adequate (or any) 
rationale is perhaps symptomatic of the same type of thinking 
that clings to the standard occupational information approach 
in group instruction — that is, the failure to recognize the impor- 
tance of individual diagnosis as pre-requisite to the applica- 
tion of occupational information. 

As I understand it, modern scientific personnel work requires 
that we attempt to specify, as Williamson has stated recently, 
“Under what conditions and with what types of problems and 
individuals will a particular counseling technique facilitate the 
desired adjustment.” To date I have found only one such 
attempt to specify the circumstances under which occupational 
information is used other than to “disseminate” it. Ruth 
Strang, writing in the School Review in November, 1945; 
illustrated the differential use of occupational information 
according to the position which a counselor occupies along a 
nondirective-directive continuum. This article represents an 
interesting attempt to clarify the role of occupational informa- 
tion in the present straw-man controversy with respect to non- 
directive-directive counseling. 

A few years ago in organizing a new course in Occupational 
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Coun-sclint!, I atfcnintt’d to formulate some differential applica- 
tions of occupational information; I am presenting them here 
not as finished prcKiucts Init as illustrative of the possibilities 
for sjtecifyjng the conditions under which occupational in- 
formation may be used. 

I have distinguished, for emphasis, between the informa- 
tionaf the re-adjustire. and tlte nmtimiUmal applications of 
cK'cupational inftjrmation in counseling. 

Perhaps the most frctpicnt and tlic best understood use of 
occupational information is, as tlie name implies, simply to 
inform. Con.sider the circumstance where the counselee has 
arrived at an appropriate and satisfying vocational choice 
based on an accurate understanding of his own potentialities 
but is tacking detailed information about the field of his choice. 
The role <jf the ctnmsclor simply is to furnisli the detailed 
information which is lacking. 

Another distinctive circumstance i.s one which calls for 
confirmation hy the counselor. This occurs when the counselee 
again has made an appropriate choice on the basis of adequate 
personal and occupational information but seeks to resolve his 
lingering indecision through a confirmation interview with the 
coun.sclor 'I’he counselor .simjdy supplements the information 
or reinforces the client with the knowledge that his information 
is accurate. I am assuming, of course, that this is a straight- 
forwartl occujiational information case and that the counselor 
is reasonably certain that this is not an instance where psycho- 
logical "weaning” is indicated. 

A still different circumstance obtains when the counselee 
.seek.s to resolve his indecision resulting from a conflict between 
what appear to be two equally appropriate goals. Here the 
counselor’s role is to supply highly specific information regard- 
ing each alternative as one possible basis for the counselee to 
make a difficult choice. 

Finally, in some instances where immediate job placement is 
the primary consideration, the choice of occujiation must be 
made in large part upon tlie highly specific information which 
the counselor furni.shes. 

The second classification is tlie re-adjustive. In my own 
experience in both school and community counseling centers 
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this has been one of the most frequently identified conditions 
for the differential application of occupational information 
The major circumstance is the use of occupational information 
with the counselee who has set markedly inappropriate goals 
for himself either in terms of level of aspiration or field of work. 
In terms of technique, the counselor first uses leading questions 
regarding the nature of the occupation or field which the 
counselee has chosen, In turn, the counselor provides accurate 
information which may enable the client to gain insight into 
the illusory nature of his thinking when he finds that his con- 
ception of the occupation or field does not fit the objective 
facts. At this point the counselor usually is able to turn the 
interview to a consideration of the realistic bases upon which 
sound occupational choices are founded. It then becomes 
possible to re-orient the counseling situation to make a re-evalu- 
ation by the counselee of his personal characteristics the initial 
phase of his vocational planning. The essence of this counsel- 
ing use of occupational information is the attempt to help the 
counselee evaluate the reality basis of his planning. This 
application is, of course, a more dynamic one than the strictly 
informational and probably calls for more skill on the part of the 
counselor. 

Other counseling uses of occupational information are 
motivational. The first set of circumstances which I have 
identified I mention with some hesitation in Chicago As you 
know, Carl Rogers postulates that “counseling can be of help 
only when there is a certain amount of psychological distress." 
Some of us, however, have forced upon us by parents and/or 
administrators the task of "provoking” our clientele to serious 
thinking about the problem of vocational choice. That is, it 
becomes incumbent upon us to gain the client’s recognition 
and acceptance of the fact that eventually it will be necessary 
to face the problem of making a living, in consequence, the 
pioblem of vocational choice. Actually, then, we must seek 
to create the “psychological distress” about which Rogers 
writes. Under these circumstances (with which, apparently, 
Rogerian counselors do not need to concern themselves) I 
suggest that counselors use those types of occupational informa- 
tion such as the number of different ways of making a living, 
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tht* incrciisiiii: didicuhy wluVh younsj }>co})le face in getting 
cstiil»lislu*(l A’fK'.uinnally, the complexity of the world of work 
etc., which may ltdp tft arouse an interest in vocational plan- 
ning 

Frcijucntly the client conceives the {troblem of vocational 
planning to ctaisist primarily of the ncqui.sltion of information 
ahout «k’ciipari(tns withcnit reference nt personal and individual 
qualifications. In chi.s .situation the counselor furnishes suf- 
ficient information ti> "hold" the client's interest until the 
client [wreeives that he must have information about himself 
as well as the world of work. Thu.s the counselor provides the 
information demanded while he works to re-orient the coun- 
selce's thinking almut the nature of the problem of vocational 
adjustnienc. 

This “holding" usage applies also to the counselee who 
wants to he told what do do. The counselor carries him along 
by providing some m'cupational information while he works 
to help the counselee become more independent. 

A somewhat tlifferenr use of occupational information is 
to “arouse" the ilient's interest in using a so-called hidden 
talent. That is, occupational information is provided in order 
to build up itlciuificarions in those instances where, through 
testing and a rc-evaluation of jAcrsonal history data, the client 
has discovered unknown talents or interests appropriate to 
fields which he has not previously considered. 

A related usage involves the “maintenance" of motivation. 
This occurs particularly in school situations where the cur- 
riculum engaged in often seems unrelated to later vocational 
activities. The counselor uses occupational information to 
strengthen the counselee 's identification with the members of a 
given occupational group. One of the most useful, specific 
techniques is to get the counsclcc started in reading the trade 
or professional journals in the field. For an example close to 
home, I have encouraged graduate students in personnel work 
to affiliate with the American College Personnel Association 
and the National Vocational Cluidance Association in order to 
build up their identification with the field. However, this 
situation can get out of hand unless skillfully handled. In- 
creasing familiarity with actual occupational requirements 
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may increase the counselee's dissatisfaction with his educational 
diet. 

Undoubtedly there are other ways of ordering and classifying 
the differential counseling applications of occupational informa- 
tion. My concern is that we cease to disseminate occupational 
information. Rather we should seek to specify with increas- 
ing exactitude under what conditions and with what types of 
problems and individuals we will use a particular type of oc- 
cupational information. 

Essentially, all that I have said involves one fundamental 
principle which is basic to any use of occupational information 
whether group or individual. Stated succinctly that principle 
is; 

Any use of occupational information should be preceded by 
individual diagnosis. 
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"What i.ui v^c, the juijiils r»r Plunkett High School, do to 
proiiiott* ivr>r!<j umk'r.sfiuuiing?'* "Ilcnv can our Camp Fire 
Girls gniu|t help F,uroj>c.'in rhililrcn?*' "Can our women’s 
club help in any way in pronutting the objectives of UNESCO?’’ 
"What can a group of univ’crsiry professors at Mainline Uni- 
versity do to help our latlleagues in China?" "Is there any- 
thing that we in group of youth organizations) can do toward 
jieacc?" 

The above tpu’siions represent samples of the thirty to forty 
reejuests whuh junir daily into the oflices of the Commission 
far Internationa! h’ducational Reconstruction (CIKR). This 
is .‘\nierica speaking, the true heart of America at its humani- 
tarian best. These people have no axe to grind, no political 
motivations, no selfish intent. They are genuinely concerned 
for their fdlowmcn. for the plight of youth in distant lands 
who must share with our youth responsibility for building a 
peaceful worUl. 'I'hey want to share directly, somehow, in 
building a peaceful world, in promoting international under- 
standing and world ccKiperation. 

Fortunately, there are many ways in which they can share 
directly in the healing of the scars of war. One of the most 
important of these ways is by undertaking projects for inter- 
national educational reconstruction projects which will not 
only help to re-establish educational opjiortunity for the youth 

’ Fttlltwing thi,'. prcsmtatitin, Harry 1) Kitwn, I’rolV-.S'or oC f'olucMion, Icnchcrs 
Colltfge, Columbia IftiivrrHiiy. Irad a panrl diu'uH'.icm on the Vocntioniu Owmai'M 
Needs in flthrr Ctmnm«<i. Di'.cus.'iaius wtre; Rolwrt Car^y, Director of Cnimance, 
Yonkers, New York; Jean 1’. jordann, A*,M*tanf Hon^rmiiswr, Soutli African Omlege 
High School, Caiwjtown; hfohamtd Abdel Salam Ahmed, Director oj Voeanonal Uuia- 
ance Deparm “ii'’, *«'in''irr i’*" Fdi'cation, Cairo, I'lgyi't; Witold Kruk-Olpinski^d- 
junct l'-(ttAii., l.'i'i.ii'.if. lit \\ i;|aw, Poland; Havard Skirbekk, 1 ns tractor, ntgn 
SchcK'i, II If;,. Ni rn.f. , 1 ,'i "t G. VVilliamson, Dean of Students, University ot 
Minr "■■n, .o..' Mirbr', It'i.'i 'o..i umversides. 
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of war-torn lands, but whicli will also strengthen UNESCO.®’ 
The initials UNESCO stand for United Nations Educational, 
Scientific and Cultural Organization, die most ambitious under- 
taking to date looking toward world-wide cultural cooperation. 
It is necessarily a complicated organization with 40 member 
nations, an international staff of 500, headed by the noted 
British scientist, Julian Huxley, headquarters in the old Hotel 
Majestic in Paris, and an array of projects ranging from the 
development of world literacy, the holding of seminars for 
international understanding, the establishment of science 
research centers, the translation of the literature of the resis- 
tance movement during the war, the establishment of interna- 
tional book exchanges, and others too numerous to mention 
Foremost among all UNESCO projects, fundamental to all ' 
UNESCO activities, is educational reconstruction. For with- 
out the restoration of educational opportunity, and of cultural 
institutions in tlie countries ravaged by war the ability of 
Europe and Asia and part of Africa to participate in long-term 
projects of international collaboration is strictly limited. 

The speaker has heard this point made eloquently and re- 
peatedly at five international confeiences during the past two 
years. He has heard educators, scientists, scholars of the 
devastated countries describe their struggles against fearful 
odds to restore tlie cultural life of their nations. They stress 
particularly their problem of reclaiming and educating for 
useful citizenship the so-called "lost generation” of Europe and 
Asia. These are the millions of youth who during the war 
years were either deprived of schooling or were subjected to the 
perverted education imposed by conquering armies, youth 
still bearing the physical and psychological scars of war, youth 
who had been taught as a matter of patriotic duty to lie, cheat, 
steal and even to kill. 

Upon these youth, who have known from early childhood the 
horrors of war and political turmoil, whose birthright has been 
hunger, cold, and personal insecurity, the devastated countries 
must depend for the leadership of the future. They will share 

» Sever.4 .specific projects were outlined by the present speaker in his remarks on 
Council Day at the 1947 convention in Columbus. These suggestions, which appeared 
in the May issue of Occtipations^ arc still valid and will not be repeated 
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wisli tiur y«>sith for buifiling a peaceful world 

If drnic4 an rtppr»rtunity Irtr education, for development of 
(how sktik and attitudes essentia! to {icrmk them to play their 
part in the nsonstrw rion of their countries, if disillusioned 
and emhittered by a j-«jsfwar worit! which seems to have no 
phue for them, they may apairt iiecomc jirey to totalitarianism. 
Deprived of opportunity, they constitute a jwtential threat 
to the security of our more fortunate American youth. They 
.tec. therefore, of concern to us Intth because we Americans ate 
humanitarians, concerned with helping suffering humanity 
everywhere, ami because see see that helping them is enlight- 
crtc<l seSf-interest. 

UNKKCCl challenges us to face this problem of educational 
and cultural rccimstniction. It i,s merely one aspect of the 
wider problem of facing the essential, obvious fact that the 
world is no longer ilivisible into distinct geographical and 
jxditic.'il areas. Tlie implication of this basic fact has not 
yet sudu’icfuly impressed itself ujKm Amcricans~"even upon 
American educators. Phr.isc.s such ns the “air-age,” the 
“atomic age," “world irucrdcjn'iidencc” arc ton often dismissed 
ns mere slogans, How scUlmu do we face realistically the 
human implication of these phrases, the irrefutable fact that 
what happens to human bcing.s in any part of the world is of 
direct concern to rhn.se in all parts. Widcsjircad insecurity, 
frustration, desperation particularly of youth“~in the devas- 
tated countries is definitely our concern. 

In November at Mexico City the second Conference of 
DNKSCO rcaflirmerl the high priority given a year earlier to 
educational reconstruction. Full and generous recognition 
was given by Dr. Huxley and by the delegates of the various 
countries to the splcndiil cooperation which UNESCO has 
been receiving from American organizations- appreciation not 
only for the size of the contributions now totalling approxi- 
mately 150 million dollars but also for the spirit of unselfish 
and sympathetic understanding which has characterized most 
of them. It was dearly brought out, however, that while the 
response of voluntary organizations has exceeded expectations, 
the need is still appalling. Continuing economic difficulties 
and political unrest have so delayed general and educational 
reconstruction that another year of intensive effort is essential. 
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Fortunately, as compared with the first UNESCO Con- 
ference in Paris, fewer countries reported in Mexico City an 
utter lack of simple school supplies such as pencils and note- 
books. These are still needed in Eastern and Southern 
Europe and in the Orient. There is, however, a serious general 
lack of educational and scientific equipment, of books and the 
means of producing them, and of trained personnel. There is 
as great a need as before for combining moral and spiritual aid 
with the provision of material assistance. 

To fill in the gaps which are necessarily left in what is essen- 
tially a voluntary effort, the conference at Mexico City author- 
ized a very limited program of direct operations by UNESCO. 
A few items of technical equipment of certain types are being 
purchased from military surpluses. Recognizing that trained 
personnel is the basis of sound reconstruction, UNESCO’s 
exchange of persons program will stress the needs of the devas- 
tated countries. A special study of the problems of war- 
handicapped children is to be made. A book coupon plan to 
permit the purchase of foreign books in domestic currencies is 
being studied. Voluntary service projects and youth camps 
are being encouraged. A limited fund has been set aside to 
send two or three educational advisory missions to the devas- 
tated countries. 

The conference also called upon the United Nations, its 
specialized agencies and all member states to see to it that all 
programs of economic reconstruction include appropriate 
emphasis upon training and education. The CIER has already 
carried out this mandate by urging the President and Congress 
to include such emphases in the Marshall Plan and in other 
governmen tally financed reconstruction activities. 

Reconstruction is clearly the one all-UNESCO concern 
which permeates the work of every section and every project 
of the organization. The implication is clear that at the 
present time the best way and almost the only way in which 
organizations can play a direct and immediate part in the 
promotion of UNESCO’s long-term objectives is to under- 
take practical projects in response to the Organization’s re- 
construction appeal. 

International cooperation is too often something which we 
merely talk about. The real test of our sincerity lies m what 
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wr a<» S hiit t« ‘l!''.Ji;ufs .UKk't' US by mir actions. Re- 

< t(n'»tr«vt!t'’n .jifnisy n ime sitrihtKi <4 action which succeeds 
not ftniy jn iJosini^ the k-aj^ heiwcen verbalization and action 
Init 4!,4,n leads ff tdirci { and satisfyirm contact between organiza- 
tions. instsHisjons and indnniuaK in this country and similar 
i»rrrti|*s abrrsid "rhroutth such projects literally millions of 
Aniprican s{h»»ol dnldren, teachers, church members, club 
memlwrs, rttisimunify leaders and professional workers of all 
kinds have lielpctl to make a direct contrilnitinn toward inter- 
national understanding* and work! jveace. Following the 
v,srinus sucttestions in the ClKR’s publications, they are 
.sendinp h«»ks aiul other materials, offering ftdlowships and 
study grants, developing advisory missions, participating in 
vfdvmtary service projects 'I'his is a ftmctional approach to 
internatitinal understanding. 

The year may well go down as one of the most critical 
Yeans of dccisittn in world hi.story. Those of use who believe 
in cdtication iisust keep constantly before us the fact that— 
essential as they are the provision of basic necessities, of 
eeonnmie assistance and of military assistance, the dependence 
tiiwn bilateral governmental efforts and upon diplomacy are 
not alone, suflicient tti bring about tile recovery and to secure 
the |K*iu:c of tlic w'orkl, Bdievens in education do not need to 
be told that war has its lieginning.s in the minds and spirits 
of men. These aspeers of human existence must be nourished 
as well as the )>hysical aspects. Our organizations and our 
institutions are demonstrating through their reconstruction 
projects a. concern for the minds and hearts of youth still suffer- 
ing from wardmjKised liandicap.s. They arc demonstrating 
through concrete voluntary action that Americans have a con- 
cern for the individual as well as for the mass. They are 
keeping before them the double objective of meeting urgent 
needs abroatl and strengthening IINESCO and the other 
United Nations agencies upon which we must depend to pro- 
vide the machinery for lasting international cooperation. 
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Introduction 


There are at present approximately 400 counselors of 
students from overseas in our colleges and universities. These 
counselors are generally called Foregin Student Advisers. 
They are responsible for counseling a laige number of students 
from almost every part of the world. In addition to the 
counselors in higher institutions, hundreds of persons in bi- 
national foundations and agencies, in professional and reli- 
gious agencies, in embassies and consulates, here and abroad, 
are concerned with the purposes and processes of promoting 
intercultural undcistanding througii the exchange of students, 

It is probable that the counselors of students from overseas 
in the U. S. A. will organize a national association at then- 
meeting to be held in Ann Aibor in May, and, in due course, 

I hope this association may be affiliated with ACPA. 

But our discussion today needs a broader context. At the 
outset, I choose to give it the broadest possible context I 
assume that we are all desirous of achieving One W orld, and 
that we believe that exchange of students should contribute 
something toward the achievement of this ultimate goal. I 
fear that we are not sufficiently aware, however, of the oppor- 
tunity we have of establishing One World in Our Front Yard. 

We m the U. S. A. have an unprecedented opportunity and, 
therefore, an unprecedented responsibility Much of our 
world looks to us for leadership today, fearful that we will 
betray their trust, yet hopeful that we shall justify their faith. 
The colleges and universities of the war-devastated countries 
were largely destroyed. In no other land are higher institu- 
tions prepared to receive large numbers of students from over- 


1 Discussniits whose comments are not recorded are Forrest G, Moore, Adviser to 
Foreign Students, University of Minnesota; Robert M. Strozier, Dean of Students, 
University of Chicago ^ 
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f»r.sN. Siutienf^ nifi'.t iithrr parfs of the world are seeking 
way.s ami nirans o! • onun,* to the V. S, A. It is estimated 
that ftom ovrr'.ras are now wmitint; for such an 

opporfunfty. 

There i*. a Inn}; standnu; and vvidesprcad hclief that exchange 
lif students is one nnportanr tneans n{ achieving One fForld 
('(mirinuR. the Moravtan hidmp and educator, wrote in 1643; 

There m sieedrd !H riie. tfnintry .in mnne»iiarf remedy for the 
trenry whin h h.n -.n/ed numy men and n linving them in their 
niathu' .** f«» then ijuitsiai dt''.fnH’iion. l'(>r we witness through- 
out the w'odd di''.i‘-Ho!i' and lie'-irtu tivc daincs of discord and 
waf’i devastaftiH! kingdoms and peojdcs with such persistence 
that jdi men ^eein t«> have emi-pired (or their mutual min which 
Will end only svnh the desrrucfjMij nf themselves and the uni- 
s'cr.sc. N'lalmig js, tlirrcfme, iimre necessary for the stability 
fif (he world, if ir is ma to {leridi completely, than some uni- 
versal rededication oi minds. Tniversa! harmony and peace 
must Ik* secured for the whole human race, Hy tK-acc and har- 
mony, however. I mean not that external [kmcc Iwtween rulers 
and iHmplrs among rlicmselves, hut an internal jK'aee of mind 
inspired hy a system oC nicas and feelings. If this can be 
attaincil, the human race has a j»ossession of great promise.® 
Comciiius Would have promoted these lofty ideals by means 
of .t Paiisophic College whose scholars from all lands might 
gather to arrange the elements of knowleiige needed for mental 
understanding among mankind.® 

Many others have dreamed of and planned for intellectual 
coojvcration and intcrcultural undmtanding. hlany indivld- 
uahs have acted on thi.s faith. Between iHio and X910 
about 10,000 Americans studied in German universities. Some 
50,000 Chinese students have come to the U, S. A. during the 
past 75 years. Before the outbreak of the World War II the 
University of Paris Itad a total annual enrollment of 40,000 
students, of whom io,<x>o were from other lands. The Ameri- 
can Association of University Women, the various professional 
societies, the religiou.s bodies, the International Rotary, a 
number of bi-national foundations and agencies, and many 
other private groups are currently engaged in the promotion 
of student exchange. Raymond B. b'esdick, President of 

* Knndcl, I. L, Inttlkctual Cmptralion. New Vork' Tenchers College, Columbin 

University, up, 77 78, . . • 

* Carr, Xvifliam (J, (hilj i>y Undmiiindin%. New York; Foreign Political Associa- 
tion, 1 945, p. 30. 
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Rockefeller Foundation, in his Review of the work of the 
Foundation for 1945, saidi 

In the last thirty years, both directly and through repie- 
seiitative national agencies m various countries the Rockefeller 
Foundation has given fellowships to approximately 7,700 men 
and women and has spent for this purpose more than 
$20,000,000. These 7,700 fellows have come from 72 different 
countries and have lepresented many races, creeds, back- 
grounds and blanches of scholarship Although scattered 
throughout the world, they have shared a common experience 
and they speak the common language of humanism and science 
(P- 43) 

Since World War I most of the major nations have instituted 
intercultural programs. France and Germany have spent as 
high as one-fifth of their foreign office appropriations for this 
purpose. Britain and the U. S. A are late comers in tliis 
field. The British Council was established in 1934 Our 
Division of Cultural Relations was established m the Depart- 
ment of State in 1938 ; its duties are now performed by the Divi- 
sion of International Exchange of Persons and the Division 
of Libraries and Institutes in the Office of International Infor- 
mation and Educational Exchange. 

"Education for international understanding” is one of the 
four major projects of the United Nations Educational, Scien- 
tific and Cultural Organization to be accomplished, in part, 
through a drive to stimulate moie fellowships, scholaiships, 
and tiavel grants for tlie exchange of teachers, students, and 
research workers. UNESCO has appropriated funds for a 
program of reconstruction fellowships during the current year 
which will provide a period of study and travel for trained 
persons from China, Czechoslovakia, Denmark, Greece, the 
Netherland.s, Norway, the Philippines and Poland. ... It is 
estimated that some 30 of the 48 fellows will come to the 
United States.'* 

Our government has recently taken positive action toward a 
program of exchange of persons. All ACPA personnel should 
be informed regarding this program which is based on three 
acts of Congress. 

I, ^he Fulhright Act, passed last year, was an amendment to 
the surplus property act. Some of the important pro- 

^ Source' Letter from Mr. Laurence Duggan, Director, Institute of International 
Education, t West 4jth Street, New York 19, New York. 
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Hit .snij dr. :*. Mij . Jakcn ujuicr jlu*. ;ut arc important 

Jnr 05!!" dis' H 

Sri'atatr ,iaHf‘!n>''i3K .iU' sum hesna negotiated between 
c.sih |».in;< i|Mi:na" .ounrry .«iul the t’nited States. 
AiiscTmcnti hau* .die.itly been m.u!e with China and 
Htsrru.s, Helyinin. tVecho, Slovakia, 

Ktiypt, hunland. hV-nnr, Ctreece. Hungary, Iran, 
Italy, fhr Wfimj'l.ind'.. Wfherlands Indies, New 
Zciil.ind. Norway, the Philippines, Siam, Turkey, 
India, PaKist.tn. .uid the rnited Kinsidom .ire eligible. 

B. thmntries p.irtst ipatinit must set .isiiie in their own 
currencies .ui .unomu .lurcetl upon, not exceeding 
$ 2 :j,o:o'.r'rr , to lie spent .u the rate of not more than 
$ 1 ir*- ' [*r}' yc.ir over a i' ■ year perirhl, for exchange 
of persons 

C, Fuiiils are to hr used to pay the expen.scs of citizens 
of the I'nifriS States in the participating countries 
and she tr.tvd expenses of n.itional.s of the partici- 
patiiii! couiurics to .ind li'fun the Hnited States, 
provitied siuh evjsrnses are payable in the currencies 
of the partiiip.uini; countries. 

I). I'hc Fresideru's Ftireign Scholarship Board has made a 
Broad interpreration of "exchange of per.sons" to 
include: prolessors. teaihers, .students, and .specialists 
in arts and scieines. 

F„ The Institute of International lulucation has been 
designated to crKirdinute the exchange of elementary 
and secondary scIukiI teachers. 'Hie Conference Board 
of the Associated Research Councils has been desig- 
nated to coonlitKitc tlic exchange of professors, lec- 
turers, research workers, tcchnician.s, and other spe- 
cialists. 'Hie 1 1 S, Office of Ktlucation will administer 
programs Am .sending teachers to public schools under 
the Fulbright Act and the American Council on 
F.ducation will do the same for private schools. 

F. Colleges and universities, professional groups, and 
other private agencies will be invited to participate 
in regional screening committcevS. 

G. Foundations will be establi.shecl in the participating 
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countries to coordinate services to citizens of the United 
States and to supervise the screening of nationals of 
participating countries seeking to come to the United 
States. 

H. It is estimated that the total funds available under 
this Act may be $140,000,000, which amount, supple- 
mented by provisions of the G. I. Bill of Rights, may 
conceivably provide opportunity for 5,000 citizens 
of the U. S. A. to study abroad each year for the next 
twenty years. 

H. Smith-Mundt Act, approved by the President, January 
27, 1948, authorizes the Secretary of State: 

A. ‘‘To provide interchanges on a reciprocal basis between 
the United States and other countries of students, 
trainees, teachers, guest instructors, professors, and 
leaders of specialized knowledge and skill.” 

B. To carry on a genuine educational program with the 
peoples of the world parallel with but separate from the 
Voice of America, 

C. To provide for exchange of persons, information, films, 
books, pamphlets in education, arts and sciences. 

The Smith-Mundt Act has been passed and approved, 
but appropriations have not yet been made for its ex- 
change provisions. Whereas the Fulbright Act is limited 
to designated countries, to currencies of those countries, 
to twenty years, and mainly to citizens of the United 
States; the Smith-Mundt Act will apply as broadly to 
the world as circumstances permit, will provide United 
States dollars, will apply to nationals of the participating 
countries as well as to citizens of the United States, and 
"can operate as long and as richly as Congress wants it 

to.”« 

It is hoped that the two acts will supplement each other. 
“For example: a Burmese student might get his transpor- 
tation to the United States paid under the Fulbright 
Act (with Burmese rupees). Once in the United States, 

“ Source. Horace Mann League Letter Number 43, laoi Sixteenth Street, N W , 
Washington 6, D C , February 2,31 1948. 
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ins IjviJii! .sn4 tunnni rsj*^‘n‘-cs miiiht he paid under the 
Snnrh \tuiKlf Aft nvitii rnited Hrates dollars).”* 

fll. fkfd !. lull Rtzhl: 

The fimrlinct'i of du'' di'anssinn is furrher attested by the 
f,u r that the (» I Hill nf Hiijhts Er.uitvS ^mvemmental 
sulKidies to cs servite prrMijinel far study in most of the 
higher eduvational institutions of the world, It is as- 
%umc«l that printrams nnide |Hi,ssjhlc by these three Acts 
w ill he i:oor«iin,ifcd. 

'rhis is merely a >kefeh of the larger context in which I 
wish to discu'is, the anuiMding of students from overseas, 
There is another consideration rd* greater imtnediate impor- 
tance. It is iH*rha[’S naive to as.sunie that exchange per u 
promotes intcrcultural understaiulimt. Those of us who have 
been ahroati with <air military forces know that experience 
ahroiul may intensify preju<lice rather than promote imder- 
Htanciing. We know, tmi, that some students from overseas 
go home with no p.enuinc undcrstandiini of nur culture. Some- 
thing more than exthanue of limlies is requiretl. There must 
he careful selection of the umfficinl nmbasstuhrs who are 
exchanged. They must he prepared in mind and heart for 
such study. .And they must he dedicated to a mission of 
service in their own countries to give purpose ami meaning to 
their experiences abroad. Much understanding must be put 
into the policies,, plans, and proec.s.scs of exchange. 

Here is where the counselor.s of .students from overseas 
come in. It is their .special responsibility to study the problems 
and to learn the prtKesscs and techniejues by which all of us 
may become more effective in our relationships with these 
unofficial ambassadors. 

This will require, among other things, a reorientation of 
our personnel officers, our faculty members, and our students. 
The job cannot be done by doing thing.s to and for students 
from overseas. We must learn to do things with these students. 
We must receive them as wformauts, as consultants, and as 
unofficial ambassadors. Knowledge of their families, their 
educational systems, their way of life, their problems, their 
hopes, and their aspirations will greatly enrich our understand- 

•nJd. 
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ing. There are many ways in which doing things with these 
students will eniich our lives as counselors, as instructors, as 
fellow students, as friends. 

This is the most effective way to assist students from over- 
seas in achieving their purposes in coming here. Once we 
demonstrate our genuine interest in them and their countries, 
they become interested in seeking from us information about 
our families, our schools, our way of life, our hopes, and our 
aspirations. 

I judge the success of our program of counseling at Teachers 
College, Columbia University, in large part by what I observe 
taking place spontaneously in the cafeteria lines, in the library, 
in the corridors, on our visits to schools and other institutions. 
Are students from overseas teaming-up with our students in 
clubs, in study groups, in theater parties, on hikes, on shopping 
trips, in the social rooms, in the dormitories, and in vacation 
periods in American homes? 

Some important considerations which I shall not have time 
to develop are. (i) Experience of the counselor of student 
from overseas confirms the critical importance of making 
available to all students an integrated personnel program, (a) 
a well-selected group of students from other countries should 
enrich the educational environment for all students, (3) a clear 
bid should be made for a greater sharing of responsibility with 
the community. 

I. Present Status of Exchange Students in the U. S . AJ 

A. There are approximately 10,000 students from overseas 
in the U. S. A. 

B. These students come from 110 different countries. 

C. There are approximately three men for each woman 

D Fully 85-90 per cent of these students come on family 
funds, or are working part-time to meet expenses. Ap- 
proximately 10-15 per cent of them hold government 
scholarships, or scholarships from private agencies. 
Not more than one-tenth of them are receiving some 


’Sourcei Unofficial Ambassadors, New York. Committee on Friendly Relations 
Among Foreign Students (*347 Madison Ave), i94-7“^94° 
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Isn.uiK i.il 4;m £<u: .md universities. Many 

.irch.nisn* i rry .iilHii uft fjnic fin.UK sally. ^ 

I’ t’hrM* ; , * • %ru#irn»'. ‘.rrk .ujmksinn ami tend to enroll 
!J! lan;rr .i»<l Kfttrr knmvn tinivcrsittfs, 

F Thr laiitesf numlirrs came from the following 

Mnsnfnf’^ 


G 


J. Ganatla 
i China 

Imha anii IChKj.sn 

4, 

V Culi.i 
h. Philippines 

7. Korwa) 

H, Ttirkcy 
I"' ranee 
lo, Greece 
n, Palestine* 

U. t'nininliia 
hH. Hra,'il 
I4. Panain.; 

K. Iran 
If*. Pern 

17. Kgypi 

18. Netherlands. 

19. Vcne/ucla 


J.Sii 

ai6n 

i,ai4 

704 

67a 

622 

55^ 

521 

470 

385 

376 

374 

354 

320 

312 

296 

283 

271 

268 


20. Poland , . 256 

. They are largely concentrated in the larger universities 


as indicated by universities which enrolled loo or more 


in 1946 47; 


1. Columbia I'niversity 

2. University of California 

3. Harvard University 

4. Univensity of Michigan 

5. New York thiiversity 

6. University of Minne,sota 

7. Massachusetts Institute of Technology 

8. Cornell University 

9. Louisiana State University 

10. University of Washington 
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1 1 . University of Wisconsin 

12. Howard University 

13. University of Chicago 

14. Syracuse University 

15. University of Texas 

16. Yale University 

17. University of Illinois 

18. University of Pennsylvania 

19. Purdue University 

20. Ohio State University 

2T, Iowa State University 

22. University of Detroit 

23. Fordham University 

H. These 20,000 students from overseas are distributed over 
the length and breadth of the U. S. A. attending more than 900 
colleges and universities. 

I. They are chiefly interested in our technology: engineer- 
ing, science and agriculture. 

1^ J, There are approximately 400 Counselors of Students 
from Overseas, some of whom are present in this group today 
In a real sense all members of ACPA should be members of 
this group, because all college personnel officers have a responsi- 
bility for this program, as do our faculty members and students. 

K. Each of these students from overseas has problems and 
needs the assistance of a counselor. Most of them have innate 
resourcefulness and manage fairly well, but some need very 
special assistance with personal problems. 

1. A Hindu student arrived from Bombay by air after an 
elapsed time of 48 hours in clothing appropriate for a semi- 
tropical climate At the time of his arrival New York was 
experiencing semi-Artic climate He had no living accom- 
modations, little money, and was late for registration 

2. Truth is sometimes stranger than fiction, as is the story 
of one of our Chinese women, who saw two of her sisters 
murdered by a Japanese soldier, who killed the soldier and 
escaped into the interior, came to the U S. A. in 1946, 
developed t. b., and is now in a sanatorium where she must 
stay for at least eighteen months 

3. A student from the Gold Coast, West Africa, after long 



?j,; I i»t'rArjr«K4j ash !'.V( jioittr.ifAi. mkasurement 

}*l.uininp 5i}T|UT,uji>n {iin,iny miina^cii to come to the 
r S. A. For A fill! >car alter his arrival he was unable to 
ohf.!in .my nifiiwv Horn ius sjwinsf^r. After his money finally 
(ji«r tltjnu.’h hr i !}■>.( "(cerni rh.if it would take three years 
more th.in hr li.ul j'lannrd u»romplctr the requirements for 
the (|rn (orate 

il. fitthffntr- >4 thr ('uuu'chir f>/ SiuJt'Ms from Overseas 

It is inijMirt.snt that we view the functions of the counselor 
in the context t»f the total }no;irain of infitrmatian, orientation, 
and cmmwhtv*'. 'rhese fututinns arc interdependent. It is 
the rcspiiisiljility rtf the ctnmselor to estahlisli a total program 
t»f exchanije of students in his institution, which is so con- 
ceived, so planned, and vt rt»ordinate<i that e.ach .student will 
fjhtain the .tssist.iiuc hr neetis at the rime lie needs it. Much 
of this proqrant will he .uKtinplishctl by others, but the coun- 
selor must take cftpni/aiu'c of wh;il others can atul should do, 
he sluiuld utili/e available rcstturces and supplement them as 
needed. 

A. The first ncetl of the prospective .student from over- 
seas i,s for information ncccss.iry for intelligent choices. Inter- 
cultural understanding rct}uirc.s a much better job in matching 
interests, alnlitics, atul needs of individuals, countries, and 
institutions. More sjKrcifically, the information needed by the 
prospective student include.s: 

I. Information about the countries offering the best 
opiwrcunities for .study in hi.s chosen field. Tliis is the first 
requirement. Should he go to England, France, India, 
China, Brav.il, or the U. S. .A,? This is mainly a problem 
for the country from which the prn.spcctive student comes, 
But tlic counselor of students from overseas must under- 
stand ir and contribute what he can to its solution. He 
mu.st prepare himself for counseling American students who 
plan to .study abroad, because he is a natural source of 
information. By way of example, consider for a moment 
where our ex-service personnel are going on the G.I. Bill of 
Rights. They arc going, or trying to go, mainly to coun- 
tries and institutions best known in the U, S. A.; Oxford, 
Cambridge, I^aris. They are almost completely neglecting 
excellent opportunities, in India, China, and South America. 
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Our information literature sent to inquiring persons abroad 
should point up this problem and suggest sources of first- 
hand information, such as: fellow countrymen who have 
traveled and studied in different countries, cultural institutes 
or foundations where they exist (and many more may be 
establislied in the future), the cultural attaches of embas- 
sies, and consuls of the different countries. 

1. Information about the institutions best qualified to 
serve the student’s needs in the country finally selected is 
the second requirement. There is too much concentration in 
a few institutions at present, both in the U. S. A. and else- 
where. It should be the general policy of governments and 
educational authorities, and thereforeof counselors of students 
from overseas, to encourage and to facilitate a wider distribu- 
tion of students, both to countries and to institutions within 
countries. In the long view this is wise policy for all con- 
cerned. I'he information literature we send to inquiring 
persons should point up the problem and make suggestions 
for its solution. Fellow countrymen who have traveled and 
studied in the country chosen, cultural institutes, cultural 
attaches, selection committees, and consuls should be helpful 
sources of supplementary information 

3. Information about how to prepare for the period of 
study abroad is the third requirement The information 
obtained by students is largely hit or miss at present. We 
should greatly improve our flow of authentic information to 
prospective students from overseas immediately One of 
our best sources of help in this matter is our present group 
of students from overseas. Most of them return to positions 
of leadership Prospective students should be urged to 
confer with a countryman who has recently studied in the 
U. S. A., and preferably with one who has studied at the 
institution where he wishes to study There is need for 
common use of a guide to students from overseas which 
will provide general information applicable to all. Such 
guides have been prepared by the Institute of International 
Education including a general orientation handbook entitled 
Meet the U S. A. These should be used by all of us, until 
more comprehensive guides are available 

There is a second aspect of information of concern to the 
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Utnnsclnr. n.imrh, ihr jnlurmarsnn nmk'd by his institution 
abtnif ilsr {ir'iv|'r< va >■ . his prrparatinn. and his country. 

‘Hus rijirtly fi»' rt ‘•p'tjiMbdsty ol the Admissions Officer, 
bur tlir , .vun*-r]f>r r. rr>.,p''<;is!!dr tor sccint; that adequate 
polmrs and prr>irdurf’s are iVdhoved in obtaining such informa- 
tion He nnisf know the sour^eN rif in formation and to whom 
fr» ;'o for asMsfam r b.vrry problem of admissions, whether 
quality of the sutdrnt .s.lmifted, delay in semling the necessary 
eertifualc o! .oinns'»ion, derenmnatbn of equivalents, or 
requirements for drrjrees, will be brought to the counselor sooner 
or later. Ilcshoidd anticipate such prtiblcms. The unofficial 
amluftsador should be carefully .selected. No .service is done 
the individual or his country, and almosr certainly the major 
objcetiv'C of intercultural ttndcr.standim' will not be accom- 
plished. if unqualiiied students arc admitted, or if the student 
is admitted to the wrong institution. Having said this, 1 
hasten to say just as entpiiatically that the proces.s of selection 
and admission mvjst be conceived as a jKTSonncl service: We 
are dealing with persons persons who arc the only hope for 
accomplishint: our objectives. Atlministrafivc convenience 
and dficicncy are nujawtant, but they must always be sub- 
ordinated to human values. I wish it were po.ssible to require 
every admissions otliccr to experience just once what it feels 
like to be a stranger in a strange land. He would certainly be 
more understamling of the human factor.s int'olvcd in admis- 
sions. The cmunselor mu.st make this hi.s concern; otherwise, 
he will be overwhelmed with problems, many of which are 
qu i te u n nec essai y . 

B. The second need of students from overseas is an orienta- 
tion to American life and the plan of study in the U. S. A., 
especially in the institution in which he is to study. Here I 
ask your imiulgence for a brief outline of the policies, pro- 
cedures, and program of Teachers College, Columbia Univer- 
sity, We have had a large number of .students from overseas 
for nearly half a century. For a quarter of a century a special 
program of information, orientation, and counseling has been 
in operation. 

I. The chief purposes of our program are: 
a) To induct the student from overseas into the life 
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of the College as a self-sufficient^ equal member of the 
student body, as quickly as possible. To this end all the 
administrative, counseling, and instructional services of 
the College are available to him on equal terms with 
students from the U S. A. In addition, special assistance 
is given as needed throughout his period of study, chiefly 
to enable him to make optimum use of the regular services 
b) To establish a relationship with students from over- 
seas which facilitates their contribution to the enrichment 
of the life and work of the College community in the pro- 
motion of intercultural understanding. 

2. The current orientation program includes; 

a) An Orientation Week is held immediately preceding 
the registration period each session and new students 
are required to attend, The principal activities of this 
week are. 

(i) Counseling. 

(a) Lectures on New York City, Columbia Univer- 
sity, Teachers College and the Plan of Study and Advise- 
ment. 

(3) Visits to points of interest on the campus and in 
New York City, with a view of familiarizing students 
with their physical environment and the transportation 
system. 

(4) Diagnostic English tests to determine the compe- 
tence of students in the use of the English language 
and to provide a basis for placement in English courses 
and for limiting programs, if necessary. 

(5) Social events (luncheons and a tea) to promote 
acquaintance among students Faculty members, older 
students from overseas, and American students par- 
ticipate in these social affairs. 

b) An orientation course in American Culture and 
Education is required of all students from overseas during 
the first session of study. This course includes: 

(1) One half-day a week spent in observation of 

schools and other institutions. 

(2) Extensive use of films on American Culture and 

Education. 
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( 3 ) Readings, lectures, discussicms. 

4) A luncheon each week, to which members of the 

faculty and selected students are invited as guest 

speakers. 

c) An International Film Scries is a weekly feature of 
the orientation program in which films of different coun- 
tries arc shown. Students from these countries serve 
as resource persons and leaders ot discu.s.sion. 'I'hese film 
showings are open to all students of the College. They 
provide one means of doing things with students from 
overseas. 

d) An International Club, membership in which is 
open to all student.s of the College, is joint sponsor with a 
faculty committee of the International Film Series, of 
social programs, and of various other means of inducting 
students from ovcnsea.s into the life of the College. 

C, The third need of students from overvseas is counseling. 

All students nceil coun.seling; some more, .some less. 

I, Students from overseas have special neciks for counsel- 
ing liocausc, 

a) They are strangers in a strange land. 

b) They are unfamiliar with American life and educa- 
tion. 

c) They often arc limited in their use of Fnglish. 

d) They often have special personal I'rohlems of finding 
suitable living accommodations, meeting the inflated 
costs of living, understanding the regulations of the 
Immigration and Naturalization Service regarding their 
visas, and knowing to whom to turn for assistance. 

c) They should have an interest in understanding 
American life. To this end they need to make friends, 
share experiences and do things V}ith students from the 
U. S. A. While such experiences should he as spontaneous 
and natural as pos.sible, students from overseas usually 
need assistance in making the Initial contacts. They 
often need tlie assistance of a counselor in matters of 
etiquette, 

f) They need special counseling regarding academic 
matters; choice of field of specialization, choice of major 
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field adviser, choice of courses, use of the library, methods 
of instruction, requirements for degrees, standards, marks 
and regulations, 

2. Policies and practice at Teachers College will serve as 
examples of one way to provide the counseling needed: 

a) When possible, information is sent by mail to the 
prosjrective student well in advance of his departure 
from his home country. Correspondence is invited. 

h) New students arc required to attend Orientation 
Week prior to the regular registration period. This 
week has proved an effective means of assisting the student 
to scttle-in to his new environment. Its chief values are 
believed to be the development of a feeling of belonging 
and the establishment of friendly personal relationships 
necessary for elfcetive counseling. 

c) All matters pertaining to the life and work of students 
from overseas are coordinated by the Counselor and his 
assis tan ts , i ncluding : 

(1) Utilization of all the administrative, counseling, 
and instructional services of the College, including. 

(a) Counseling by major professor and instructors. 

(b) Healtli counseling, vocational counseling and 
psychological counseling. 

(2) vSpecial counseling of students from overseas 
During the first session, especially during the first 
weeks, and decreasingly throughout the student's 
period of study, the student needs someone to whom he 
may go for counsel on any matter which disturbs him, 
whether trivial or important. This requires among 
other things: 

(a) The establishment of a relationship between 
the counselor and the student which is friendly, 
permissive, and completely frank. 

(b) Authority of the counselor for coordination 
and for final approval of the program of the student 
for the first session, including: 

(i) Choice of field of specialization 

(ii) Choice of major professor, 

Oil) Control of amount of work to be undertaken 
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by rhe. studcnc whose competence in the use of 
Knj*!iKh is liniited. 

(iv) Requirement of courses or tutorial work in 
English when needed. 

(v) Requirement of an orientation course in 
American culture and ctjucation iluring the first 
,se.s.sitin to provitle experience, interpretation, and 
counseling necessar\' for a gradual induction of the 
student into tlie corporate life of the college com- 
munity. 

(c) .‘\ftcr the comjdetion of the work, of the first 
session flic student may return to the counselor for 
assistance. Imt by this time he .should have become rel- 
atively self-sulhcient m knowing the resources of 
the College and in making use rrf tlicm. lie should be 
more or loss on a ]nu- with other students, except for 
special proltlcins peculiar to stiulents from overseas, 
or to the individual. 

III. of the Colon e/or of Students from Overseas 

I need notdiscu.ss the professional and jrcrsonal qualifications 
of counselors in general. We are douhtle.ss in substantial 
agreement that the effective counselor of students needs much 
more knowledge than mo.st of us luive. I a.ssume that the 
counselor of students from overseas should meet high standards 
of professional competence. But I am chiefly concerned in 
this discussion with the personal qualities of persons who 
counsel students from overseas. No amount of professional 
preparation and experience can possibly be a substitute for 
certain necessary personal qualities. Here, I indulge in a bit 
of idealism. 

A. The personal qualities of the counselor must include as 
large a measure of the folkrwing qualities as possible,; 

I. Fundamental belief in and commitment to the American 
way of life; its ideals and asjiirations: its problems and solu- 
tions; balanced by a belief that the U. vS. A. is not perfect, 
but could be improved and enriched by contact with other 
cultures, 
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a. Kundamentid belief in and commitment to the inter- 
dependence of all peoples and the need for intercultural 
understanding, 

3. Fundamental belief in and commitment to the exchange 
of students as one of the most effective means of promoting 
intercultural understanding and 0 ?;e World. 

hundamcntal belief in and commitment to counseling 
as a necessary means of accomplishing the objectives of 
exchange of students. 

5. Genuine sincerity and frankness in all human relation- 
ships. 

f d. (ienuine interest and faith in people, as persons, for 
their pre.sent worth and for their potentialities, and whole- 
some per.sonal relationships with his own countrymen. (The 
po.sition .should not be a channel of escape for persons who 
cannot get along with their “own people”, so seek solace in 
strangers), 

7. Genuine interest and faith in students from other 
cultures, as persons and as unofficial ambassadors 

8. Genuine .sympathy with and understanding of the 
problems of students from overseas. 

9. Great patience in assisting students from overseas in 
solving their problems. 

10. Firm belief and conftdence m one’s self as an effective 
counselor of students from overseas. 

11. Ability to work harmoniously with other agencies and 
departments both within and outside of his institution. 

B, Professional qualifications of the counselor should in- 
clude as many and as much of the following as possible: 

1. Knowledge of the chief characteristics of the culture 
ofthell. S. A. . 

2. Knowledge of the chief characteristics of other cultures 
of the world. A genuine interest in learning from students 
from other cultures is indispensable. 

3. Travel and/or study in other countries is highly desir- 
able. 

4. Knowledge of the theories and techniques of counsel- 
ing, of human relationships, and of intercultural under- 
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standing is essential. If the counselor does not possess 
such knowledge, he should set about obtaining it as q^uickly 
as possible. 

C. Necessary administrative arrangements for effective 
counseling, include: 

I. Appointment of a qualified person to serve as counselor. 
1. Allotment of adequate time for counseling. It should 
be undeistood that effective counseling of students from 
overseas requires much more time, perhaps twice or three 
times as much time as that usually allotted to American 
students 

The following schedule is suggested as a target: 

a) 1-15 students, one-tenth of the full time of the 
counselor. 

b) 26-50 students, one-fifth of the full time of the 
counselor 

c) 51-75 students, three-tenths of the full time of the 
counselor. 

d) 76-100 students, two-fifths of the full time of the 
counselor. 

e) 101-150 students, one-half of the full time of the 
counselor. 

f) 151-200 students, three-fourths of the full-time of 
the counselor. 

g) 201--300 students, full time of the counselor. 

h) 301-500 students, full time of one counselor, and 
one or more assistant counselois. 

3. An easily accessible office or student center for counsel- 
ing and related activities is essential. 

4. The counselor must have a liberal schedule of posted 
office hours and be accessible at other times for emergency 
problems. 

IV. Need for Professional Preparation of Counselors of 
Students from Overseas 

With students from overseas now distributed among over 
900 colleges and uni vei si ties and with over 400 counselors 
already serving in these institutions, the time has come for 
special professional education for such service. Such profes- 
sional preparation should include adequate courses and prac- 
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tical experience in counseling. While thorough professional 
preparation as a counselor prior to service is desirable, this 
is quite impossible at present. The major portion of the 
counselor’s professional preparation, therefore, must be ob- 
tained on the job; chiefly through learning by doing in the day- 
to-day counseling of students, by cooperation with and learning 
from other counselors, by study of professional literature, and 
by participation in research in this field. 

Among the purposes of the proposed national association of 
counselors of students from overseas should be the development 
of professional attitudes, the conduct of research studies, and 
the|stimulation of individuals to seek professional preparation 
forjtheir work. A first step in offering such professional educa- 
tion will be taken by Teachers College, Columbia University, 
in the Summer Session of 1948. I quote from the announce- 
ment : 

Education saopMx— Practicum for foreign student adviseis, 

4-S points. Professor Clarence Linton and Miss Virginia 
French. 8:30-11:20 a.m. and 2:30-5 p.m., 2 Milbank. 
Regi.stration by permission of the instructors. Limited to 
twenty-five students. 

This course is planned for persons already appointed to the 
position of foreign student adviser m a college or university, or 
other agency ; and is designed to assist them in developing more 
effective advisement and orientation programs for their respec- 
tive in.stitution.s or agencies. Requirements include partici- 
pation in the varied program m Teachers College; in class 
discussions of programs, problems, procedures; in readings and 
research; and in preparation of a comprehensive program for 
the students’ own institution or agency. 

In this practicum students from the U. S. A. (i e., counselors 
of students from overseas) will be full participants along with 
an approximately equal number of students from overseas in a 
variety of Intercultural activities, including: 

1. The orientation couise in American Culture and Education, 
where the counselors will serve as consultants and resource 
persons to help the students from overseas to understand us. 

2. The International Film Series in which films of the U. S. 
A. and of different countries will be used as sources of informa- 
tion and as a stimulus to discussion of the different cultures. 
In this activity the counselors will serve as informants and 
consultants for American films and the students from overseas 
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will serve as informants and consultants for the films on their 
respective countries to liel[) us to understand them. 

3. Visits to schools, to the United Nations, and to other 
institutions and agencies will provide further opportunities 
for sharing; experiences. 

4. F.ach counselor will be teained-up with a difierent student 
from overseas each week (six different students from six dif- 
ferent countries during the Summer Session) for study, con- 
ferences, preparation of written work, and other activities 
'rhu-S each student, from the U.S.A. and from overseas, will 
have an opportunity to know fairly well at least six persons 
from another culture. It is believed that these experiences 
will encourage genuine sharing of knowledge, problems, atti- 
tudes, ideals, and aspirations, from which we should learn 
something about intercultural understanding. 

5. In addition, the counselors will have a two-hour session 
to themselves with the instructors for lectures, discussions, 
evaluation of their experience, and for jdanning programs for 
their own institutions or agencies. 

[ H Cofic/tisiou 

The American people’s interest in other peoples of tlie world 
is running high today. We have come to understand, perhaps 
only vaguely and superficially but nevertheless witli feeling, 
that our future welfare is tied-up with and dependent upon the 
welfare of others. Education is teeming with projects designed 
to teach the techniques of intercultural understanding. Height- 
ened concern with the exchange of students is one manifesta- 
tion of this interest. 

It is the responsibility of educational leaders to provide 
specific objectives, a sound program, and techniques which 
will focus this potential of interest and canalize efforts to build 
a sound foundation for long- view policy and sustained achieve- 
ment. 

I earnestly urge that the ACPA accept the challenge of the 
opportunity and responsibility of promoting an effective pro- 
gram of exchange of students by: 

I, Facilitating the admission and enrollment of students 
from overseas. 
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1 . Recommending the •appointment of qualified persons to 
serve as counselors to students from overseas. 

3. Recommending to your administrative officers and faculty 
that they support the appeals of the Institute of International 
Education and those of other groups to impress upon your 
congressmen and senators the need for adequate appropriations 
for exchange of students. 

4. Recommending that the effoits of your institution be 
coordinated with those of other institutions and agencies, so 
that we shall marshall the total force of educational leadership 
to meet this challenge. 

The people of the U. S. A. are investing many billions of 
dollars in peace. We shall probably invest 17 or more billions 
to help Europe achieve peace and recovery. This investment 
is necessary for us as well as for the peoples of Europe and the 
world. If ERP contributes to the peace of the world it will 
have been worth many times what it will cost in dollars. 

The greatest investment in peace must be in the minds and 
hearts of people. The program of exchange is such an invest- 
ment. Now that our government has taken the first significant 
steps in the G, I. Bill of Rights, in the Fulbright Act, and in the 
Smith-Mundt Act, we, the college personnel officers of our 
higher educational institutions, should put our best thinking 
and efforts into the program. 

In closing, I venture a prediction and set a target. We have 
approximately 10,000 students from overseas today. This is 
about four times as many as we had in 1938 We shall have 
30,000 by 1950 and 60,000 by i960. This prediction is based 
on the assumption that peace will be achieved and maintained 
and the further assumption that our colleges and universities 
can and will accommodate these increasing numbers of unof- 
ficial ambassadors with mutual profit to them and to ourselves. 
The total cost of 60,000 students from overseas for 40 years 
would be less than the cost of ERP for the first year. 
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WILLIAM B. Wl-I^H 
PfC'iidlciie, IJ. S. National Siucicnt Awociatton 

I SHOULD like to share with you some of the observations 
that I have made in the last few months while working on 
the Staff of the National Student Association. One of the 
important things on which I liave been assembling data is— 
how well is the teaching and practicing of democracy being 
carried out in our colleges and universities? It has been both 
encouraging and discouraging at times to get into bull sessions 
with student leaders from many different types of colleges 
and to find out what they are really thinking. 

We all know that within a university community there are 
usually three general divisions ofper.sonnel directly concerned 
with the educational piocess the admini.stration, the faculty 
and the .student body, It is true that over a pericKl of many 
years the administration and faculty have been able to develop 
fairly logical and workable means of coordinating their ac- 
tivities, and the structures by which this can he done fairly 
easily have been set up. .‘Vt least it appears this way to the 
students, But the third group, the studen t body, has generally 
been the last group to attempt to coordinate and organize its 
activities. In fact it would be safe to .say that in the majority 
of cases this has only been going on in the last thirty years, 
and then with varying degrees of success. 

At first glance it might seem that the physical problems of 
organizing thi.s transient group, which has .spent little if any 
time in the specialized field of higher education, would be 
insurmountable. However, 1 believe that surprising results 
have been obtained in the past, and es[)ecially arc being brought 
about in the years since the war. 

* Discuswnts whose eommetus tire not recorded nre Williiim Biretibaum, Director 
of Studeot Forums, Universit); of Chicugo; (Jordon J. KJopf, AdministmOTC Fellow, 
Student Personnel Service, University of Wisconsin 
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Let US call this organized student group that we shall be 
discussing the student government, and see in what light it is 
looked upon by the members of the three large divisions on the 
campus. I have found while talking with faculty members 
and administrators that some of them hopefully look for some 
ideal .system of student government which can take off their 
hands the red tape and confusion of student activities, Others 
of this group seem to think the student government is a fine 
place to put a great deal of the responsibility for the dis- 
ciplinary problems that arise on the campus. Others feel 
that it is dangerous to give students too direct a way to express 
their opinions and that the student’s only role in college is the 
attending of classes and the passing of exams And then there 
is the group who do helicvc tluit work in student government 
is an excellent way of developing potential leadership and 
understanding of oiganizational problems, but Tm afraid the 
the group fhat looks upon student government as a place to 
encourage an understanding of the real meaning of living 
within a democratic society is all too small. 

I’ve also talked with a great number of students, and am 
sorry to .say the general attitude seems to be even more dis- 
couraging. All too often I’ve heard such comments as — “Oh 
that’s just an outfit for the big-wheels to get their name in the 
paper’’ or "It’s only good to run a dance, but it never does 
anything for me.’’ Sometimes the students even feel that the 
real reason for student government is to put up a front for the 
administration and that really the dean holds a veto over any 
worthwhile project that might be undertaken. 

Of course the whole purpose of outlining these observations 
for you is to bring out what NSA feels is the real purpose in 
having a student government. The long range purpose should 
be almost self-evident; itisto provide students with a practical 
education in democratic self-government. It is in effect an 
in,surance policy for a nation that prides itself on the capacity 
of its people to govern themselves. We feel that in any discus- 
sion of this nratter student government should be regarded 
primarily as a learning process in which the lesson taught 
through actual practice is the hard and tiring way of an ordered 
democratic society. We recognize that democracy is probably 
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the most difficult form of uovenitneiu ;ind .system of ordering 
a society ever conceived hy man, hut that it is the only suc- 
cessful one in which the imlividual is given a full opportunity 
for intellectual and moral growth ami in which he may use 
his full capacity to contriluite to the common good, And 
within this context we fed student government has an impor- 
tant role to play. A.s the report hy the Harvard committee 
on Ckurral FJucution if! ft Free Suciely cxprc.s.sc.s it “Student 
government is valuable in .sluijiing the quality of later citizen- 
ship. It is only when the student face.s the actual difficulties 
of governing by ticnuKTacy that he hegiim to appreciate the 
complexity of a free society. To learn to re.sist jirc.ssure, to 
discover the power of a minority, to have free speech used 
against one. to prescribe rules and then to abide by them is 
training of the first tirder.” Thi.s then is what stutlents may 
learn if they have the opportunity of partici[ntting in student 
government activities. 

The .student government it.sclf, like any government, has two 
major functions to serve the people it is made up of, and to 
represent them ilcinocratically to the other grnuj>s with which 
those people must work and live. Xow to discover whether or 
not student governments really have the chance to do these 
things, and the opportunity to learn those things listed by the 
Harvard Committee, .some system of evaluation should he de- 
veloped. The individual college should be able to evaluate the 
workings of democracy within itself, and then the level of evalu- 
ation of democracy should he brought down to the individual 
student. We must have the tools for analysis within the reach 
of the campus. It is very commendable to talk of saving the 
remnants of democracy on the international scene, or in VVash- 
ington. But the evaluation of what I am looking for must not 
begin there. It must start within the fraternity house and in 
the Union building. There must he some new sort of check list 
or criteria of action by which every student can evaluate his 
participation in the democracy of the campus, 

It will do little good for NBA to tell a student government 
where it is making mistakes or for us to write an editorial in 
the NSA News about the undemocratic student government 
at a specific school. It will do little good for members of the 
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stiuleiit government- ro cull the members of the student body 
apathetic or to criticize the members for taking little interest. 
Each individual student government must work out for itself 
the tecluiiques of making democracy a learning process, and 
each student must lie urged to participate and then to evaluate 
his own part. 

I would further like to sec some method of evaluating de- 
mocracy not only within the student government, but within 
the whole educational community. I’m afraid too often it is 
the bad example set by the faculty and administration of a 
college that puts our students on the wrong track when they 
form a student government. It is much easier to sit behind a 
shiny desk and say to a gioup of students that this can be done 
and that can’t. It’s easier for the president of the student 
government to run his affairs with a yes or no answer, but we 
would all cry loudly if this were the method used in our local 
or national governments. It is always harder to reach agree- 
ment througli tlic free exchange of ideas and by majority 
decision. 

1 hope that from this group will come the suggestion to each 
of your student groups that they wind up their activities this 
year with an overall evaluation of how well they were able to 
use the democratic process in their work this past year. Before 
they can do this, of course, they will have to evolve some sort 
of criteria to judge the democracy of their work. I hope that 
many of them will take tl\e time to do tlris. The results of 
thi.s shoukl certainly he kept for the new members the following 
year, so tliat they may sec tlie strong and weak points of their 
predecessors. I’hen each of us in our work with student 
governments .should stop and take a look around. Do we feel 
that discipline is the prime objective of our work with student 
activities? Are we afraid of making a mistake by letting the 
student government stumble slowly along in the democratic 
process ? 

’I’he example that e.ach person in the field sets in his own 
practices will be a determining factor in how student groups 
function. Let’s not wave the American flag and think it is 
grand to give lip service to democracy, but rather let us think 
out how we can put democracy to practice within our own 



prt nrHiCATIONAI. VNf) (*.SYC"HOI,(>C,U'Al, Mr.ASURKMr.NT 


spheres f)f influence, and make it live ami grow. If democracy 
fails within the educational circles fjf America, I hate to think 
how mi.serahly it will fail in the city, state and national spheres. 

Perhaps I have [iaintc<i a rather bleak scene For a minute 
I would like to think of the reasons I believe the university 
community is an ideal place for even the transient group of 
students to learn the workinus of tlcmoeracy. Here the student 
has an t)p[)orlunity to deal with problems within his own scope 
without too mucit outsiilc interference, atui in ureas where 
mistakes can be. accepted. 'Poo often it is because of fear of 
public opinion against the university that sufficient areas of 
defined authority are not turned over to students - -and because 
mistakes might be made. I feel that one of our first jobs is to 
inform the public that student government is a learning process, 
and is an accepted jtart of each university system. Also work- 
ing in a siudent government give.s the students a chance to see 
that the solution to organizational jirohlems dues not lie in 
merely writing a beautiful constitution, I don’t know how 
many times this year I have heard that .some student govern- 
ment is rewriting its Constitution. I wish 1 could call out to 
all of them not to get jainmed-up in words. Imt to put their 
efforts into making what they have work. 

Let us look briefly at some of the speeijk mistakes that are 
being made today in this fielil. 

I. I feci that there has been a failure to outline clearly the 
areas of authority in which a student government may work. 
I realize that In every instance this authority will properly 
come from the administration of the university, but it must be 
clearly outlined and understood, and it must be complete. 
The advisors that work with student government should 
realize this and constantly be on guard to see that they do not 
try to pressure decisions in the area,s in which authority has 
been clearly delegated. 

a. Highly organized campuses, especially those with in- 
dependent and fraternity grouiKS, are prone to take the politics 
of student government us something that can be kicked around 
for excitement, 'Phis talking and playing politics for politics 
sake is often exciting, hut if that is the end, it is usually the 
end of functional student government. 

3 . Many of the larger university student governments find 



DEMOCRACY THROUGH STUDENT GOVERNMENT 


5^7 


their meetings almost completely dominated by consideration 
of athletics. In some cases this has been carried to the ex- 
treme and resulted in the complete neglect of broader con- 
siderations of student welfare. 

4. One of the worst faults that I have run into is the student 
government's accepting the responsibility for a conglomeration 
of disciplinary power.s over student behavior. I am sure that 
wherever discipline is the stated or actual prime purpose of 
having a student government, the student government is not 
very effective in that field or any other. Too often I have 
found that rules and regulations are left unexplained to new 
generations of students, and the only people who know that 
discipline is in the hands of the student government are the 
administration and a few of the student council members 
themselves. Di.sciplin.iry functions of student government 
should be taken on only as the whole student body is willing 
to accept the responsibility. The ideal situation might be for 
a set of jurisdictional by-laws that required reacceptance each, 
spring by the student body. This would always keep the 
responsibility before the changing student body, and give 
the student council a vote of confidence in this very important 
field. A group that .starts its existence with an imposing list 
of jurisdictional or disciplinary powers won’t have a very 
long life. It will soon find that it is losing the respect of both, 
the administration and the student body as it finds it can not 
use police powers wisely. If it becomes clear that one or two 
disciplinary powers arc being handled effectively by the stu- 
dent government, an additional power might be added each 
year until a workable list is obtained. The key to the ideal 
situation, however, is to have the whole student body accept 
the responsibility, and not just to have the executive body 
of the student government act as a policing agency. 

Now let US consider where student government does function 
successfully, and in what areas constructive projects that are 
beneficial to the campus are being carried out 

1. The coordination of campus social activities, and their 
expansion until every student has an opportunity to participate, 
has been the concern of many student governments. Several 
have expanded intramural sports. 

2. Some students governments have surveyed housing 
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fiicilities in the Kurnjuiuiinu cuimnunity. and checked up on 
local restaurants to see that they arc keepinti hiph health 
stantlards. 

3. Man)' of the stiuleni stovernmcnis have taken on the 
project of runnint' a campus ectmmunity chest and consolidat- 
ing all of the \'aried relief aiul welfare drives into this one 
campaign, 

4. There has been increasing interest in the problem of 
constructive student evaluation of teachers, and several 
student governments have taken the lead in ccKirdinating this 
project with faculty groups. 

5. At one school the student government has been instru- 
mental in obtaining a place for at least one student representa- 
tive on every university committee, tltus tying in more closely 
the loose ends of the educational comnuiniiy. 

NSA’s role in this broatl jficturc of student government is 
primarily to make more effective the work of the student body 
in the university comiminity, anil to act as their representative 
and consultant in national and international educational, 
and governmental group.s. 

C)ne of our fir.st jobs on the national scene this year was to 
compile material and information on the actual structure and 
functioning of student government. We have published a 
booklet on Sturkut Goventment and Leadership in Higher Educa- 
tion- and along with it sent plans for student government 
clinics that can be held by mtercstcci groups on a single campus, 
and by several schoohs in a region. A survey of 360 colleges 
is being completed to show the functioning iind structure of 
student government in all types and si'/.es of colleges and 
universities in the United States. 

Several of our .sub-commissions on various campuses are 
doing similar planning and survey work in such Helds as seat- 
ing in football stadiums, use of upjierclassmcn as advisors, 
personnel and guidance, orientation programs, election pro- 
cedures and campu.s social activity organization. 'Fwo of the 
regions arc working on regional cultural festivals, and inter- 
school dramatic and musical events have been initiated and 
coordinated through the NSA channels. 

Some of our most immediately successful work has been done 
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in the field of international student activities. Under the 
sponsorship of the NSA the MIT student government has 
helped to arrange lor the study of 80 foreign students, expenses 
paid, at a summer course at their university next summer. 
Plans arc under way with several colleges for a program de- 
veloped jointly hy tlic Canadian Federation of Students and 
the NSA for exchange of students each year between the two 
countries. The student governments at many schools have 
actively supported the World vSrudent Service Fund drives for 
the first time. NS^X i.s a national sponsor of VSSF. 

NS.'V has made special arrangements for 100 students to 
take a planned tour of Great Britian, Holland, Belgium, and 
France this summer .All arrangements were made through the 
various National Unions of Students in those countries, and 
we have supplied each student government with booklets and 
bulletins giving a full picture of all the study, travel, and work 
opportunities abroad this summer. Student governments 
are^heginning to make these services available to the members 
of their student Inalies. 

We hope that through NSA we can help individual students 
to look beyond their classrooms, and to encourage them to 
help themsclvc.s with their educational problems. NSA itself 
is a learning prc)ce.ss and will never reach any ultimate goal in 
itself, but it will make the job easier for its member student 
governments and will piovidc them with channels through 
which their activities can be expanded into the regional and 
national scene. It is with this in mind that students from 
all types of colleges are willing to cooperate and to work with 
each other in tlie National Student Association. 



HUMAN NATURl*: AND KDUCATION 

HAlUn.n TAYIJfJR 
I’rriidrnt, Saf^h I.awfrncc C«!lej^c 

It is wtch some diffidence rhat I speak this evening about a 
subject as complicated as human natuie and human growth 
before an audience so knowledgeable and so skilled in both of 
these Helds. I am a philosopher who gave up thinking to be- 
come a college president, I feel tluu I might have some pro- 
fessional competence, remaining from that happy life of the 
past, to deal with questions such as the structure of the uni- 
verse, the destiny of tlie human race, ami the nature of freedom. 
But as to the bigger questions of giving advice to college 
students about what to study, how t(» study, when to study, 
how to know what ctne can do, how to get a job, and how to 
avoid going mad, which I take it is the Inisincss of the dean and 
the pctsonnel petiple, these arc much tor> intense and difiicult 
matters for me to handle with any coidiilcnce. What I shall 
do, theteforc, is to make philosttphical remarks about children 
and how they grow, then g<j on to rccommeml a philosophy of 
education to wliich I have become attached, and end by 
suggesting one or two rcvohuion.s we might .st.irt which I think 
would improve matters considerably. 

First of all, I would like to say .something about human 
nature, and the qualities of human nature which we IcKik for in 
liberally educated people, I believe that the liberally educated 
person is one who i.s deeply interested in life and who enjoys 
it one way or another, a per.son who i.s sympathetic and generous 
in his attitude to other jieoplc, to other cultures, and to other 
countries than his own, who accepts his world and himself 
as a growing, changing entcrpn.se in whose advance he has a 
slgniftcant part to play, who is .sensitive to the beautiful and 
the ugly in action.s atul objects, wlu) bdievc.s in human rights 
and human freedom, who lias a degree of knowledge and knows 
how to get the knowledge he doesn’t have, and has at least a 
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moderate skill in the art of living. It would also help if he were 
rational. 

There are a good many ways in which these qualities are 
learned, and a great many different kinds of people who show 
them, - composers, poets, scientists, farmers, workers, and 
sometimes even profes,sors. It is not necessarily a matter of 
school and college education, since the qualities develop in 
other places, It is a matter of educating the feelings, the 
thinking, and the values of each person. 

It is clear, I think, that values are learned, not always con- 
sciously, by the particular set of situations in which people 
spend most of their time, by the direct and indirect personal 
influence of parents, teachers, friends, and employers, I 
believe I could defend .successfully the view that the value of 
things and ideas is learned only by the immersion of the in- 
dividual in the stream of human relations which make up his 
daily life. I’he value of money is not learned through the 
study of economics but by the immediate awareness of what 
people can or cannot buy with it. The value of democracy 
is not learned by the study of American history or Greek 
philosophy, but by learning what it actually feels like to be 
democratic. 'I'lic value of ideas is learned by working with 
people who have them, who are willing and able to exchange 
them. 

To me this means that a truly liberal education begins with 
the cliild when he explores his talents and desires. His mind 
and the rest of him all grow together as he plays with clay, 
rides a tricycle, wrestles with his contemporaries, and learns 
to cooperate with his friends. For the child, fortunately, it 
is almost impossible to separate the training of the mind from 
the other things he does, since it is very clear that his mind is 
that part of his life which helps him to explore his world suc- 
cessfully and to satisfy his own need for knowledge and under- 
standing. A genuine sense of wonder exists in each child, 
and eacli one asks about the origin of things and why they 
happen as they do. The child continually looks for values and 
for truth, and his search- leads him to the things which later 
make up the formal studies. The way in which we measure 
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the intelligcnt'c and f.iients (tf children when we ate not in- 
volvctl in the inliibitiim ju-neesses of what we call their educa- 
tion, i.s by the way they respond to the sitnation.H in which we 
put them, the liveliness nl their interest, the readiness with 
which they eyas[i the meaning of what we say and what they 
say to each othei. This tif tour.se involves the things they 
know’, hut the thinu.s they know are those they have learned 
ihrouuh living them. In chihlren, we recognize the fact 
that there is a close relation between iKUSonality and intel- 
ligence, and when we speak of chihlren, we try to asses.s them 
as creatures who are mtire or less plea.sant to have around, 
more or Ic.ss able to cope with themselves and with others, 
and more or less woi thy of any elforts we may wi.sh to put 
into their fnrthcT education. 

Nor do we ask con.stantly for tests of memory, or prcsciip- 
tions of .subject matter, since in the youmr. life i.s a wliolc and 
cannot yet be sliced into academic seumenr.s. \Vc are glad to 
have the child involved anil growing (o his maturity by a 
variety of means. We want him to learn to live in hi.s world 
by .seeing relations between one thing and another (philosophy), 
undersuncling hovs? to ileal with himself and other people 
(psychology), what are the names and places of things f.sciencc), 
how to enjoy hiin.self (the arts), how to exert influence on hi.s 
parents and other J'cople (.siwial science), how to count and 
work things out Cmalhcmatica), how to imagine I’cople and 
situations (literature), and w'hat are the most de.sirablc ways 
to behave (the humanities), 

Altogether, if wc are parent.s or teachers, wa; want the child 
to change and grow in whatever ways seem most significant 
to his talents. Our role is to set the moral structure widely 
enough to allow freedom, and narrowly enough to prevent 
chaos. We do not wuint each child to he the same, we usually 
want him to be like his mother or his father, or failing these, 
like an important person outside the family whom we respect 
and admire. In former yeans, this was invariably a captain of 
industry, or the head of something important like a bank. 
Now we are for the most part content with less. We will 
usually settle for an offspring who seems to have himself in 
hand and who is not too severe with his parents. 
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I believe that the divetsity of human nature is one of its 
chief attractions, and that any effort to work against the spon- 
taneous diversity of luiman talent is doomed to failure, It 
will fail ei tiler by accomplishing its ends, and making a stand- 
ardized product of dull uniformity, — and thus something less 
than human, or by producing an Interesting rebel who 
refuses to be standardized. In either case it fails. My 
suggestion is, ihercforc, that as far as human nature is con- 
cerned, we put to full use the things we know about human 
behavior from .studying the young. This means that educa- 
tion will have to stop acting as if human nature is everywhere 
the same, will have to deal with people one at a time, and will 
take as its goal to release in each person the talent which lies 
within, 

I believe that the philosophy of education dominant in 
America today is the opposite of this and is calculated to pro- 
duce a staiulaid college graduate, approved by the authorities, 
possessing a standard body of knowledge, and guaranteed to be 
educationtilly house-trained During the past five years, 
there has heeii a gicat amount of talk throughout the country 
about refortit of education. On the whole, this has resulted in 
a move backwards towards the tighter organization of the 
intellectual life of tlic college student, and a reaction against 
new ideas for educational change. Educators, I am afraid, are 
now thinking more about mental training and the faculties 
of tlic mind than about developing mature persons. The 
reasons for thi.s' reaction are in large part the lesult of the 
failure of the elective system to give genuine unity of knowledge 
in education. 

The unity now souglu is in the direction of general education, 
and is the result of a sincere effort to avoid the hazards of 
special and narrow education, and at the same time to achieve 
a breadth in knowledge which will equip each student for con- 
temporary life. 

However, wlicn eilucators have set to work to carry out 
reforms, they have composed their committees, and their re- 
ports about committees, around the idea that the whole matter 
is one of subjects to be studied. Professors from each depart- 
ment in the university have tried to think of subjects they 
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wisli they had been compelled to study when they were young, 
or subjects which, by sheer miniber of departmental members, 
have been v'oted into prominence in the curriculum, Having 
thus decided what the.se .subjects aie, a new and required 
curriculum has been made, intended to give a general view of 
everything, or, to put the aim another way, to make jieople 
specialists in the general. 

In all this manipulation of subject matter, the student, his 
needs, his world, ami his judgments about his nectls, have been 
ignored and cxdudctl. Along with the student have been ex- 
cluded the dean of students, the psychologists, the counselors, 
the ones who know what bothers the hoys and girls. They 
know because they are the ones who talk to them outside of the 
classroom about things of deepest significance in their personal 
lives. In the absence of the student and his spokesmen, the 
counselors, the professors have talked and voted themselves 
into a standard curriculum which combines and rearranges 
in new clusters all the subjects and courses which have been 
given harmlessly enough for yeans under different and less 
complicated titles. 

I believe that the clue of these ambitious efforts at intel- 
lectual purity is to he found in the classical view of human 
nature held, a good deal of the time unconsciously, by members 
of the academic profession. According to the classical view, 
the individual human being is identical throughout the whole 
of the species, he contains a mind in the same way that an 
egg contains a yolk. Just as there is a universal method for 
hatching eggs by placing on the nest the curriculum of the 
universal hen, so there is tlie classical curriculum, everywhere 
the same, which can guarantee the hatching of correct knowl- 
edge in the universal student. To use language which is 
more respectable, the mind of the individutil, in the classical 
theory, is a rational entity, constant throughout its human 
occurrence. Although the body may change, and may vary 
from person to person, and may occasionally get the mind 
into trouble, it has only incidental relations with the mind, 
and thus has little to do witlr liberal education, or the intel- 
lectual life. A major part of traditional education, for this 
reason, consists in wrestling with the body and trying to keep 
it from interfering with social and intellectual processes. 
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The flaw in tliis \'iew of human nature is that the things we 
really care ahout have their roots deep in the body, and that 
desires, ideals, sex. .sensibility, joy, and a number of othei 
useful assets, are more ba.sie to human life than the incidents 
of the Intellect It is important to add immediately that the 
intellect, or mind, is a great aid to us in achieving the ends 
toward, s which nur tiesires would have us move. The intellect 
also gives u.s consiilerable help in tleciding in which direction 
we wish our tk-sires to set ahout moving us. 

A modern theory of Iniman natuie and education is there- 
fore more complicated than the classical theory. It accepts, 
for example, the influence of social environment on the personal 
character tif the indn-idual, and works by all the ways it can 
to discover wliat changes occur in the one due to changes in the 
other. It accepts the existence of an unconscious mind whose 
effect is perliaps more powerful in some instances than the 
consdou.s, since it ciperates to influence desires when we are 
unaware of its very existence. A modern theory assumes that 
there is a direct relationship between cliildhood experience and 
cliaracrcr in later life. It accepts the view that motivations 
and talents are different from person to person, and different 
in eacli pei.sttn at different times in his life. In other words, 
it accepts as observably true the fact that the individual human 
being i.s a .special case, and that if education is to be effective, 
it must deal with the emotional, intellectual, and social needs 
of the people it is .serving. In a very real sense, the whole of 
education is guidance to life. 

Those of us who are entrusted with the guidance of the young 
toward a full ami happy life are placed in a situation of crucial 
importance. I think it i.s clear that we are living in a period 
of social tension ami confusion of purpose which has no prece- 
dent in the hi.story of civilization. Although we may not feel 
that we have the knowledge and the insight to tell our students 
how to act ami how to live .st> tliat contemiiorary civilization 
is aided tt) .surtdve, it i.s our duty to make the effort, both by 
becoming as tilear as we can as to the nature of our crisis, and 
as clear as we can about the best means to overcome it. 

Tlic elements of social crisis have no doubt always been 
present during the history of the last two thousand years, yet 
in no age before our own has man been so self-conscious about 
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it. We have Mr Tfiynhees Ht)r«i thal when eivilizaticms 
appear to be at their nio.sf healthy. prf)s[K-r(niH. and bhairniriiT, 
they are actually rnttinit away at the core, atul that the igno- 
rance of one’s own prccarioii.s position is simply a failure to 
recogni7.e social eri.sis until after it has happened. Thus, the 
rosie.st apple contains the hiime.st worm. Since Mr. 'roynhee’s 
hypothe.sis cannot be verified, and is much too di.squieting to 
use in thinking about one's own personal condition, I suggest 
reversing his view and, by a happier logie, which has just .as 
much chance of being true, hold that when civilisation .seems 
to he at its worst stage of eri.sis, it is actu.dly at its most jiromis- 
ing. In this way, I find that I can face the future very nicely 
and with an amount of historit.d tiitjnity cepud to that of Mr. 
Toynbee. 

I believe that it is important to recounizc that our pre.sent 
crisis has .special qualities, and that it is not just another period 
of the sort which has followed wais in the past. Its prime 
fact is that for the first time, we have the means, and to some 
degree the will, to ilestroy the wluile of conrenijiorary civiliz.i- 
tion. Our age is murketi by its use of power, violence, tenor, 
and intimid.ttlon as the .stand.irAl means of settling social 
conflicts, with a sharp decline in the use of petsua.sion, appeal 
to moral values, and respect for personal right.s, 'I’he .symbol 
of the age becomes (ihandi, the world’s only apostle of love, 
assassinated by an intellectual ])olitical opponent. Ten years 
ago, the symbol of tlic We.srcni crisi.s was Chamberlain, his 
umbrella, his gout, 'riie age is now marked by an enormous 
increase in the sources of various jiowers useful for bullying 
])eople, whether througli tlic movies, tlie ratllo, tlic newspapers, 
atomic energy, or economic monc)polic.s. Its favorite words 
are confusion, action, and temsion. It is marked by the growth 
of the importance of pohlics and collective thinking and acting 
for the benefit of .state.s. But perh:ip.s more .significant than 
any of these things, and in large part a.s a result of them, it is 
marked by a disintegration of moral confidence and conviction, 
and the disappearance of the individual, 

The function of education therefore is to re.store to the in- 
dividual hl.s confidence in him.sclf and his ability to solve his 
social problems. The prime educational need is for knowledge 
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of our piesent situation, and an understanding of the human 
forces which arc making our future. Otherwise there will be 
no future, but only an uneasy five years with an enormous 
bang at the end of it 

I have read recently the statement, wntten by an educator 
from this vicinity, that in order to survive, modern man needs 
only to know the content of a group of special books. It has 
been said that ah caily the discussion of these books has altered 
“the tone and subject matter of conversation in considerable 
areas of the United States.” This may be true. The drawing 
rooms of America may now resound with the ring of famous 
names, but the society which surrounds them remains largely 
unaffected. I have seen a classification of one hundred ideas 
which contain in themselves all the central concepts necessary 
for dealing with this or any other crisis Such a group of 
classified abstractions is of the same order of meaning as the 
Chicago telephone hook. If you work at them long enough 
you will find a human being at the other end. 

Fortunately, we liavc a clear line of action shown to us by 
those American educators who have written the Report of the 
President's Comnnssum on Higher Education. A modern 
philo.sophy contained in that document declares the action 
should be to educate the individual, wheiever he may be, to 
give to each the kind and amount of education and training 
appropriate to his talents, to give to each an understanding of 
the present, and to give to each a set of ideals towards which 
a better life and a better society can move. These ideals are 
learned and absorbed by so organizing the college life of 
each student that he shares responsibility for the lives of others, 
has a chance to think and act independently, and is able to 
receive the advice and aid of his teachers and counselors 

In other words, the whole of college life should be made into 
one piece, 'fhe gap between the academic and the personal 
must be closed by the union of counseling with learning, learn- 
ing with acting, and acting with knowing, Here is the sig- 
nificant jdacc for the educators whose assigned function it is 
to deal with the social and personal life of the student. In their 
hands lies the opportunity to teach democracy and with it 
intellectual, emotional, and political maturity. 
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Admissions programs can he ilcviscd to select students most 
qualified In personalitv and intdlitrcnre, to remove racial 
barriers, to bring in tliversity of talent. 'I’esting prourarns can 
be revised to eliminate the statistical approach to human 
values. Housing arrangements can be made to eliminate 
racial discrimination, and wheic such discrimination appears 
on our campuse.s, we can invent educational means nf correct- 
ing the attitudes of those who [mactiee it. It is not enough to 
put in jv required cour.se in race relations lor white (icntiles and 
to sit tight. It is a que.stion of blcmling the divmity of .stu- 
dents from all social, racial, and economic groiqi.s into a com- 
munity of free-thinking, humane, ami generous young men 
and women. Social snohbery, Inc<l in the fraternities and 
sororities and fostered in campus politics, can he dealt with by 
deliberate educational [mlicies developed by .students and 
faculty. Anxictie.s about jobs and the future after college 
can be turneil into purpo.seful educational planning when 
vocational guidance is conceived as the attempt to develop 
intellectual and .social con.sciousnes.s. Political maturity can 
be aided by eiieouragement of free tliscu.s.sion of all ideas, 
radical and conservative, and of all the issues currently facing 
American youth. .Simply to take, one at a time, the issues 
raised by the coming clcetion.s, to enable each .student to dis- 
cover for whom he will vote, i.s a n)ean.s to under.standing and 
an aid to wisdom. 

The revolution I recomnrend can therefore be stated very 
simply. Let’s give the colleges back to the .students. The 
meaning of education can only be grasped by those young 
people wJio seriou.sly take hohl of their own lives and make 
their own knowledge and value systems. When academic 
educators attempt to take over this task for the benefit of the 
young, it simply establishes an illusion of control by the few 
over the many, d’he influence of the chussroom as an educative 
factor sinks to a minimum and the growth of the young self 
occurs without benefit of intellectual guidance. Only a life 
in the college community in which each student feels that his 
presence makes a difference, and in which he feels he has a 
personal stake in deciding questions concerning his own educa- 
tion and college policies, can give to our young the maturity 
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they are willing and anxious to gam This is pai ticularly true 
in our present situation of cxxess numbers and standard pro- 
grams. I he individual is lost m a welter of requirements 
and people. 'I’o restore him to the center of the institutional 
life i.s the basic neeil and the central purpose both of professors 
and dean.s. At ime.sent it is not being done by the professors. 
I am suggesting that college .students are mature enough to 
be tni.stecl, wise cnougli to be guided, and eager enough to be 
educated. Let us therefore give them more responsibility 
and more chance to work out their own destinies and education 
The new curriculum for American education must therefore 
extend beyond the classrooms, the libraries, the laboratories, 
and the offices, deep into the elements of contemporary life. 
It must touch the personal attitudes of the student at points 
where he can feel his own re.sponsibility for thinking and acting 
well. The impact of that curriculum will not be confined to the 
subject matter of courses, It will spread through the whole 
of the college. 1 fere the test of whether a subject is part of a 
genuinely liberal eilucatiun will not be its traditional status 
in college catalogues, hut whether or not it yields an under- 
standing of tlic most crucial questions of our present lives, 
Finally, the curriculum must, throughout the entire scope of 
its action, be concerned with art. The joy of creating one’s 
own knowledge from a diversity of sources is one kind of art 
The joy of making and appreciating the objects of the artist, 
is another kind, But as in the case of the child, of whose 
philosophy I have spoken wistfully earlier this evening, the 
joy of living, growing, and understanding is the basic art to 
master. The value for which we search is the one we can gain 
only by putting together a life which has its uniquely private 
rewards and makes uniquely its creative contribution to the 
proces.s of society. If we believe deeply enough in the search, 
we can, by our own future actions, sliow that human Ideals are 
greater tlian the material and social embodiment by which 
they are presently expressed. 



SOME IMPLICATION'S OK CLIENT-CENTERED 
COUNSKLINCJ FOR COLLEGE PERSONNEL 
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Thk attempt to vitilize iKc principles of clicnt-centcrcd 
counseling is in one respect an irritating thing. The basic 
hypothesis appears to operate with sufficient effectiveness in 
therapeutic work with inaladjustecl indlviiluals, that one is con- 
tinually plagued by the question “If it works in dealing with 
the person with problems, might the hypothesis [nove true in 
this other tyjie of human relationshi]), fir this, or this?” So 
today I shall pa.ss on to you some of those tjuestions that have 
occuircd to me and iicr[ilexcd me in regard to various phases 
of student personnel work at the college* level, I hope that 
these questions will provide a basis for discussion. 

I do not wish to talk about client centered therapy as such. 
I am sure many of you are familiar with .some of the attitudes 
and ideas related to that iioint of view. Perhajts as a point of 
departure 1 might try to stale as adequately as I can in one 
sentence the hypothesis which is central to this orientation, a 
liypothesis which ajipears to find backing in our clinical experi- 
ence and in the slowly growing body of research data. It could 
be stated in these words; that the individual has a high degree 
of capacity for making an adjustment to life and its problems, 
a capacity which can be most fully released in a non-threatening 
psychological atmosphere whiclt is permissive, accepting, and 
deeply understanding, where the individual is able to consider 
himself and his situatifm clearly, including those elements 
ordinarily denied to cnn.sci()us awareness. This has been the 

‘ Diiicii.waiita whofc comment*, nre not recorded nre Rdw.ird .S. Jones, Director of 
Personnel Research, Uniyensity of Bufl’ido; Ksther IJoyd-Jones, Prolwor of Educa- 
tion, Teachers College, Columhia University; James A. McClintock, Director of Per- 
.sonncl, Brothers College, Drew University; Willard W, Blaesser, I)ean of Students, 
Washington State College, 
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hypothesis unclerlyiiijr out clinical work, and it is from the 
orientation thus provided that I should like to raise certain 
questions about college personnel work. 

I 

The first question is, "Where is knowledge of the student 
integrated as a basis for action?” As one studies college per- 
sonnel work, the lieart of it appears to be knowledge. There is 
knowledge of the student’s intellectual abilities, his vocational 
aptitudes, his personality structure, his emotionalized attitudes, 
his academic history, his past and present grade record, his 
family environment, his pliysical and neurological condition, 
his dormitory behavior, and so on and on. The various ways of 
obtaining this knowledge have all been carefully considered 
and developed by workers in the field. But it is obvious that 
none of us is interested simply in the accumulation of knowl- 
edge. It is knowledge as a basis for integrated understanding, 
planning, and action, which is important. And there has been 
surpri.singly little thought given to the question, where shall 
we lodge this responsible integration of knowledge, this function 
of responsible jilanning and action? 

There is imiilicit in much of the literature regarding student 
personnel work tlie concept that this responsible function should 
be lodged in some ilesignated individual such as the counselor 
or the dean of students. Sometimes it is implied that responsi- 
bility should lie with a group such as a case conference, in which 
both the knowledge and responsibility are pooled At the 
other end of the continuum is the less accepted concept that 
the integration of significant knowledge, the responsible plan- 
ning of action, the taking of action, should be centered in the 
student himself. I'lie locus of the function of evaluation, 
according to this point of view, should remain in the student. 
The increased interest in using college program-planning as a 
responsible learning experience for the student, instead of an 
administrative and guiding function, is one evidence of this 
point of view, Another is the attempt to have the student 
select the types of psychological tests he wishes to take, and 
to have him also bear a primary responsibility for the meaning 
the test results will have for him. Thus there are a number of 
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people in flie srudcnr persuniiel fiekl wlm are giving up the 
notion of thinking the .stiuieiit and /r;r tlie student, in 

favor of thinking ivit/i the student 

The question I am raisinu may he put in another form. 
What are the loni: range implieations of a theory of .student 
personnel work which puts the integrating focus of personnel 
information outside of the .student him.sclf? .Speaking from 
the point of view of my own clinical cx|wriencc. it appeals' to 
me tliat effective integration of knowledge is best achieved 
within the student, ami that thus has concomitant values in 
developing independence and matuiity. I tend to favor this 
end of the continuum not only because it.s effectiveness appears 
to be borne out by clinical experience, and by some research, 
but also because I happen to favor a ileeply democratic political 
philotiophy. 1 feel that any point of view wliich tciuls umieccs- 
surily to substitute direction by others for intelligent self- 
direction, leads away from ilernocrary. 

One of the thing.s which frightens me about student personnel 
work is its complacency in rcganl to its long range effects. If 
we believe that time will tend to jierfect our tools and extend 
the functioning of the personnel iniint of view, then we believe 
chat it will eventually be applied to us. If we are happy about 
its application to students, then we will lie happy wlien it is 
applied to us. But I doubt this. Du we believe that we will 
be better, more effective faculty members when the dean, or a 
dean of faculty iiersonnel, has the complete record of our lives, 
our abilities, our personalities tile same type of record we are 
striving to build up in regard to students? When your request 
for curriculum changes, for lietter teaching facilities, your 
request for promotion, your difficulties with the Buildings and 
Ground.s Department, your tensions with your wife, aie all 
understood by a benevolent dean in the light of your test results 
and your Korschach pattern, will you, will your university be 
a better place? Certainly much wiser guidance can be given 
you. You can be helped to sec that promotion is hardly justi- 
Red in view of your ability on the College b'aculcy Aptitude 
Test, which has enabled us to select such a homogeneous 
faculty. It can be gently hinted to you that the dissension in 
your home and your truculence in faculty meetings as well as 
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your disputes with the jiinitor, grow out of your unresolved 
conflict in regard to authority, and that psychiatric guidance 
would assist you in all three respects. When you leave for 
another university, your cumulative record can be forwarded 
to your new dean, who can also evaluate you and your behav- 
ior in the light of all this knowledge. 

Do we like that picture? It is the direction in which an 
increasing portion of the world is moving. Life seems too com- 
plex. We should surrender the responsibility for our lives into 
the hands of someone wiser ---a dean, or a psychiatrist, or even- 
tually of course, into the hands of the state. If this is a social 
trend, then should we not go along with it? Should we not be 
happy that much of student persionnel work is already in tune 
with this point of view ? This is a basic question which I hope 
the panel will discuss. I will simply state that for myself, the 
only reason fcjr opposing the trend is that clinically I find it to 
be true that thougli an individual may remain dependent be- 
cause lie has always been so, or may drift into dependence 
without realizing what is happening, or may temporarily wish 
to he dcperulent because his situation appears desperate, I have 
yet to find the individual who, when he examines himself and 
his situation deeply, deliberately chooses dependence, chooses 
to have the integrated direction of himself undertaken by 
another. 

Though I have described the issue all too briefly, and may 
have confused rather than clarified by looking at it from various 
angles, this is the deepest question which I should like to raise 
for discussion by the panel. I will repeat it in a somewhat 
different form. How do we evaluate the tendency in student 
personnel work to build up an increasingly complex body of 
information about the individual, the organizing center of which 
is located outside the student himself? 

II 

There is a second general question of quite a different sort 
which I should also like to raise, It is this; “Can the basic 
attitudes which appear to be effective in individual counseling 
of a client-centered sort, be applied to work with groups of stu- 
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dents, to work in rtiniinittces, to the teaeiung of classes, to the 
administration of student personnel staff uroujw?" 

The experience wc have had in urtm]-) rlierapy and in dealing 
with croup tlynamics is nor as extensive as our experience in 
individual therapy Research in this area is still relatively 
meager. Nevertheless certain statements wtnild appear to he 
justified, which might he rleseriptive of our clinical experience 
to date. 

When a group faces a prohlein or problems; 

When the leader is genuinely tree of a desire to control the out- 
come of the group exfHTiencc, 

When the leader resi>ects the capacity ol the group to meet its 
own prohlems; 

When the leader has -kills in releasing individual expression; 

TAw; 

Tile individuals Ixigin to express attitudes, and to l>e respon- 
.sible for their own attirudes; 

Both conscious and heretofore rlenicd attitudes are brought into 
the discussions; 

The individuals iiei'ceue their artifudes and themselves differ- 
cntly, and consequently (XTceive tlieir pioblems diH'crently. 

The group develops a sfiong “morale”, and feeling ofeloscness; 

The individu.il or the group dtqHauimg upon the tyiH.* of 
prohlein works out constructive ways ol realistically han- 
dling the situation. 

Could these group procedure.^ he apidicd to situations faced 
by student personnel workers? There is reason to feel that 
they could. Cautious cxperinicntation would .seem justified. 
We have handled grouj's of students with personal problems 
and tensions. Re.sults vary from the student who feels it has 
been an interesting experience of no particular personal value, 
to the individual who feels that group therapy has been one of 
the mo.st valuable experiences of his life, and whose behavioral 
changes bear out this judgment. Wc have also tried group 
therapy as a means of rctlucing anxiety jtrior to comprehensive 
examinations. The re.sult.s arc not condu.Hive, hut warrant 
further exploration. 

A situation faced hy the student personnel worker in which 
such methods might be used, is the task of freshman orientation. 
Often the orientation proce.s.s con.sists of a week of meetings in 
which information is gently and steadily jKiurcd over the head 
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of the stinicnt, witli wienie roasts and inspirational talks to 
make tlie process bearable. Suppose that instead beginning 
students met once a week during their first semester in groups 
of not over twenty, to talk out their confusions, their fears, 
their resentments, their feelings of inadequacy, and their sense 
of growth . 'I’lie group could be conducted in such a way as to 
make it their group, an opportunity to develop a clear and 
realistic orientation to their own situations. Information, 
probably mostly in written form, could be made available to 
them. 'I’lieie i.s reason to believe that students would use such 
an opportunily in a responsible fashion to work out a personal 
orientation to the college situation. Group morale appears to 
be an almo.st inevitable accompaniment. I know of only one 
situation in which just such an orientation procedure was used, 
but it was regarded as highly successful. 

Let u.s examine another area in which personnel workers are 
involved, clas.srocmi teaching. As we have attempted to apply 
learner-centered procedures to university courses, we have 
become convinced that it is difficult, and that we have not solved 
all the issues. Hut it is also very clear that such an approach 
can have extremely vital results. It means largely giving up 
the attempt to teach > and attempting instead to create condi- 
tion-s which facilitate Icetrttb)^. This is a very different thing. 
When it is achieved, when the leader is genuinely a catalyst and 
not a mentor, the group shows remarkable capacities for coming 
to grip.s with the real i.ssucs, for self-initiated learning, for intel- 
lectual and emotional growtli. As one student said at the end 
of such a coui.se: “All my life I’ve made a ceremony of burning 
my notes at the end of a course, to show I was finished with it; 
in this course I have a totally different feeling, that I have just 
begun to learn, and that 1 want to go on,’’ 

The same policies would apply to our handling of student or 
student- faculty committees. If we clearly leave the responsi- 
bility with the group, if we are genuinely understanding and 
nonjudgmcntal when emotionalized attitudes are expressed, 
we are likely to find vigor and life and the taking of responsi- 
bility by the group. Many college personnel workers have 
realized this and have come to utilize more and more deeply 
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the strengtli of tfic group, rather rhan to try to lead through the 
imposition of their own strength. 

Let us look too at the way in which wc function as adminis- 
trators. Many (jf us have some rcsjMUisihility for [icople under 
us: staff memhers, (.Icrical workers, and the like. l)ne.s the 
client-centered point of view have any iniplicathms for the way 
in which we carry fjn such a funetion? 

Here 1 should like t'» speak cpiite per.sonally of niy own experi- 
ence, s. Since I9J0 tor nearly twenty years I liave had 
administrative resiMinsihility for stall’ groups of one sort or 
another. I had developed ways of haiulling ailministrative 
problems -ways which had hecotne fairly well fixed. Certainly 
.as I hecame more and more deeply interested in a client-cen- 
tered type of couii.seling, it was furtliest from my mind that it 
would ever affect the way in whicli I lie.dt with organi/ational 
problem.s. It is only in the last two 01 * ihrce years that I have 
heen really aware, of the revokuhm in administrative I'rocedure 
which it might bring about. I wouit! mention again a point I 
made at the outset, that the effectiveness of a elient-ccntercd 
approach in counseliiuj means that these concepts continually 
force themselves into other aiaais where one had not thought of 
u.sing them, 

h'or niy.self, I have found it luith difficult and rewarding to 
attempt to apply these concepts in administration. I am sure 
there are many aspects of the applieatitm which 1 do nor under- 
stand, or do not see clearly. Yet there are certain tpiestions 
which I can ask myself almut the udmini.stration of an organi- 
zation, to which I believe I see the answers. I .shall list and 
comment on these tpiestions, 

1, Do I trust the capacities of the group, and of the individ- 
uals in the group, to meet the problems with which wc arc faced, 
or do I basically trust only my.self? I find that when I take 
the risk, the gamble of resting my confidence in the group, 
ingenuity, responsibility, and strength, arc multijiled. If I 
am fearful of doing that, and rely on myself, lids produces in 
the group passivity, a willingness to sit hack and criticize, and 
dries up initiative and constructive effort. 

2. Do I free the group for creative tiiscussion by being willing to 
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underslancl, accept and respect all attitudes, or do I find myself 
trying subtly to manipulate group discussion so that it comes 
out my way? I find that this tests one’s basic philosophy very 
deeply. It i.s all too easy to give a group pseudo-freedom, just 
as there i.s much jiseudo-client-centered counseling going on, in 
which the atmosphere is permissive up to a point, but then con- 
trolling. The results arc the same in counseling or adminis- 
tration. \Micn there is a genuine willingness for all attitudes 
to be expressed- critical and hostile as well as constructive- 
then the group senses the fact that it is their organization, and 
they respond witli vigor, with loyalty, and with responsibility, 
Wlicn the clei'ical staff is as free to contribute attitudes as the 
professional staff, then perhaps tltis principle is most deeply 
operative. On the other hand, if the freedom is of the “pseudo” 
variety, then suspicion develops. 

3. Do I, as leader, iiurticipate by honest expression of my 
own attitudes Ivut without trying to control the attitudes of 
other, s? 'Die essence of a client-centered point of view is not 
passivity, as so many have supposed, but respect for the right 
of the person to be himself. In a situation such as a staff group, 
where I am most certainly ego-involved, it is as important that 
I cxpre.s.s my feeling as that the next person does. But this 
will again test tloeply tiie leader’s philosophy. He can express 
his attitude in .such a way as to imply “and you had better 
think the same,” or lii.s expression can on the other hand imply, 
“this is just one feeling, and others may have veiy different 
attitudes.” 

4. Do I rely upon basic attitudes for motivation, or do I 
think surface procedures motivate behavior? It has been our 
experience that wlten a problem is felt by the group, and freely 
and openly considered, and a way of meeting it is discovered 
and cxjKM-ienccd liy the group, action along those lines follows. 
If this process has not been achieved, no amount of formal 
agreement will bring constructive action. Motions, rules, 
formal decisions arc as meaningless as New Year’s Resolutions 
for the individual. In our Counseling Center staff, formal 
motions are almost unheard of. The group seems to be an 
organism, and when it feels itself to be clearly integrated, action 
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follows inevitably. ^Ylu■n it is in eonfliir, at tion is confused 
or conflicting, ami no amount of neatly tjpcil policy will make 
it otherwise. 

5. Am I willing to he responsible for those aspect.s of action 
which the group has (leleeateid to me? If T tlo not wi.sh the 
re.sponsihility I slunihl say so. If I accept it, I ant ftbliged to 
carry it out. 

6. Do I trust the imlivkhial i«i tlo his job? Here we plunge 
directly into the question ttf wh.it is supervision. If.super- 
visitm is the task of an overseer. tlirectiiiL; the imiivitlual as' to 
how he does his work, then I think much of what I have de- 
.scribed is negated. We have come to put new meaning into 
the term .supervision. \Ve regaui supervisory contact as the 
oppornmity which the individual has to tliiiik tlirough more 
clearly the problems he is nieetiinr on his job the unpleasant 
demand.s ntadc iukui him. anti the way he will ailju.sf to those; 
the failure experienees he is having in his counseling; the prob- 
lems he may feci in his iiersoiial orient.ition to the stall'. Wc 
find that the more the imiivitlual is given the re.sponsihility for 
his job, the more tieeply he accepts it, bur when someone else 
assume.s that responsihilitv then hi;, atritiuic* is, “I ju.st work 
here," 

7. When tensions occur, do I try r«» make it [lossiblc for them 
to be brought our into the open? I think aiiministrators tend 
to think they arc doing well if m; tensions are evident. t)n the 
basis of our experience it .seems much .sounder to accept the 
fact of tension as basic, and to learn to deal with it. People, 
because they are living [leoplu, are bound to be at times dis- 
satisfied, to feel out of line witli the group, to feel jealous, to 
feel critical of others, etc. Wc have come to believe that it is 
only when a tension is displacetl in it.s object that it is dangerous. 
If the staff feels I have been uki dictatorial or have played 
favorite.s in .some action of mine, only comstruefive thinking 
accrues if that is told to me, 'I’hc experience may he painful, 
but it results in growth. But if it is bottled up, ami expressed 
only in opposition to some new jHjlicy pro|)o.sal, then it does 
not dissolve, but tends to hecontc heightened. If staff mem- 
ber A is resentful of staff member B whom he feels to be too 
ambitious, the expression of that feeling to the person toward 
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whom it is directed is again, painful but constructive. But 
when this jealousy or hostility is expressed by A only m criti- 
cizing B to others, or only in opposing B’s ideas about counsel- 
ing, then tension grows. So we have found it highly important 
to try to create an atmosphere in which real attitudes can be 
expressed toward their real objects. When this occurs tension 
is reduced, and almost inevitably perceptions (and hence 
behaviors) are altered. In such an atmosphere morale is not 
always superficially sweet, but it is sound and real, and experi- 
enced as a significant anchorage. 

We feel that in this attempt to apply client-centered prin- 
ciples to administration we have much to learn, but we feel 
that such application holds the exciting possibility of discover- 
ing basic scientific truth in regard to principles of interpersonal 
organizational relationships, truths which may greatly enrich 
and deepen our concept of democracy. 
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I'A'RR since niati ceased heinj: an i.snlared Imife hack in the 
early Am, and hci»an tr» live ciith nthers in a nmre organized 
social structure, there have been constant deviations in his 
behavior from acceptable coniinunal standards. I’he.sc anti- 
social aberrations have nici n<it only with disapproval from 
the group us a whole, but also with planned repri.sal or punish- 
ment from leaders id' ilie iiroup in behalf of the groujr. 

To prevent continued misbehavior, laws were gradually 
formulated, and inethoiis for diseipliniiu: wrongdoer.s were 
devised, Tmlay discipline is an accepted, il not a pojmlar, 
social control in our .scheme of complicated livinu;. 

What is di.seipline? 'Phe dietionary defines it as a .system of 
rulc.s eon trolling conduct ; as corrective measures or punishment. 
All too frequently punishment is the only eonnotation aroused 
by the word discijdine, I’o most jicople diseiplining a person 
means punishing him. Our school system Is no exception to 
thi.s point of view. Even on the college level punitive discipline 
has been, and in many ca.ses still is, the atlministrator’s con- 
ception of how best to correct and prevent undc.sirable conduct. 
Lloyd-Jones and Smith point this out effectively: 

The Kysteni uf rules and iH'tialtifs wliieli imw exist-, in iiio.st 
of our iiiRtitiitions probably constitutes a kind of band-wasliiiig 
gesture on the part of the adminisrrarion vvhieli either docs not 
desiic or does not know how to handle discipline iiy methods 
more truly educational. One readily eimceiles lhai U is lela- 
tively simple to write down detailed dirfctioiis. whiclij if 
meticulously oheyed, would result in ,i minimum of viciiil Irie- 
tion, Aliy office clerk can also make up a list of {Hm.dties for 
the infraction of each of these rules. It rhett iKaomes a rela- 
tively .simple matter for any dean or faculty eommittee, no mat- 

yDi.scu«tan«s whow conimcni'. are mii reoirded arc Kieplirn M. Cwcv, I’rafesMir 
of Kducntkm, University ol Cliitago; Linioln B. Hide. Prcoileni, Kvan^villc College; 
Mflfgarei Holmes, studcni, Antiodt College. 
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ter how lacking in imagination and teaching skill, to assign 
punishment to individuals in terms of rules and punishments 
without much jeopardv to the punisher’s feeling that his duty 
to ‘society is heing righteously fulfilled^ 

“How can vvc eradicate objectionable behavior/’ one dean 
asked, “or put a stop to infractions of rules if we do not take a 
firm stantl and let the students see by dire example the penalty 
they will suffer if they disregard standards of good taste or 
flaunt university regulations?” 

: Another dean replied, “Administer your discipline in such a 
way, that your offender ceases thinking that his real mistake 
was getting caught and realizes instead that his mistake was 
doing something undesirable. Discipline must help the student 
to understand wliy he acted as he did, and must assist him in 
deciding for himself whether this type of behavior befits him as 
an intelligent, maturing young man.” 

Lloyd “Jones and Sniitli elaborate this theory: 

Anyone with experience in any of the better behavior 
clinics would undcr.stand that it may be possible to secure spe- 
cific outward conformity by exerting external authority but 
that, if the Iwhavior failure is due either to ignorance or lack 
of skill or to some underlying emotional cause, it is futile to 
expect results of a lasting character through the imposition of 
a group’s authority. The chances are, in fact, that real harm is 
done to the individual by this course insofar as any genuine 
possibility for reeducation and rehabilitation are concerned,® 

The mtHlcrn concept of college discipline is predicated on the 
student personnel philosophy that discipline is an educative 
process, corrective, and not punitive. It should be a learning 
experience affording the student every opportunity for under- 
standing himself better. It should also play a vital role in 
helping him adjust with greater facility to behavior patterns 
more acceptable than those which originally gothim into trouble. 

College students always have, and always will get into 
trouble. This i.s not abnormal, for in the main tlie problems 
which beset this particular age group are normal problems of 
adjustment, heightened and accentuated by the peculiar and 

’ Lloyd-J'.>iv:'(, Iwtlicr iind 
llixhtr Julucaiwn, New York 
Uid.) p. 1 26 
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unn;itur.il I'nvirmum'nf uhjcli ccfiistsfuti'.s ;i imiver.siry com- 
munity. Smli a coiniiuiiiisy. <-si*ci'i.i]ly in a hmall college town, 
comprises a concentrated uroup ot youny men and women, all 
within the same ace limit*-, all umleriioinju (he same proce.ss of 
intellectual, einotifiiial, and pliy'-nal inaturatitm. ami all tem- 
porarily living, wurkinij. eating, ami sleepinu in a restricted 
framework of adult inijKi.scd reintlations. 

The.sc young [teople are still unsure of their cap.ieities, yet 
eager ftj he considered iiuicpendeiir and resi»on,silile. Their 
hopes run high, their ambition is unbounded, and their physical 
energy i.s umpienehahlc. 'rhey are highly eompetitivf in their 
quest for status, tremcmlously uneasy in their search for long 
range security, and ever restless because their urge for mating 
is nor fully sublimated or satisfied. 

The oneness of this college gr<tup in such respect, s has, of 
course, been disrupted in recent years by the wulening of the 
group’.s age .span, arnl the introduction to cla.ssroom routine 
anti campu.s mores of oKler men and women, many of whom arc 
married, and most of whom have matured overnight m uniform 
in far-Hung camps, or hattiefields. 'rius infiux of veterans, 
with its consequent .skewing of the eampms age span, has in 
itself brought tm now problems and multiplied tiKi ones. 

There always have been, and probably al\vay,s will be certain 
areas of campus disturbances: Cheating in examinations, with 
perhaps such occasional tactics as ransacking tifiice.s and profes- 
sors’ homes for advance copies of final examinaiioms, i.s a con- 
•stant headache. 

Thievery flourishes; 'I’he library steadily loses books; 
lockers are broken into and rifled; fraternity houses are sys- 
tematically robbed ; residence halls have their spasmodic waves 
of light-fingered pilfering; .students "lift” souvcnir.s from stores 
in pianks which the courts call larceny; text books disappear 
when .students leave them lying around unprotected. 

Sexual misdemeanors peritalically ticcur. It seems impos- 
sible to eliminate window peeping, genital exposure, preg- 
nancies, homosexual and hetcro.sexual irregularities, many of 
them adolescent, some of them pathological. 

Drunkenness, gambling, destruction of property, and objec- 
tionable, disorderly conduct stalk along just often enough to 
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make everybody aware of their existence and their need for 
correction. 

University regulations are constantly being abrogated. 
Residence hall rules are broken; student privileges are abused, 
“no jiarking" and "no .smoking” requests are disregarded; 
gradc-s on the registrar’s official records arc falsified. Some 
times such behavior is willful, sometimes accidental, 

In the area of intcr-pcrsonal relationships many incidents 
regularly happen which the head of residence, a dean, or some 
member of the faculty liandle as a counseling situation rather 
than as a disciplinary act. These misdemeanors are not re- 
ported tlirough the usual disciplinary channels because they 
do not seem to be serious enough to warrant standard dis- 
ciplinary procedure, and generally they are wisely handled. 
Actually all discipline should be thought of as counseling, and 
should be administered as such, in order that it may be a 
therapeutic factor for the offender in his reconstruction of 
better attitudes and his establishment of more acceptable be- 
havior patterns. 

There are sharp differences of opinion about this concept. 
Tlic disci[)linarians in many colleges, whether they be in- 
dividuals or committees, maintain that a university is a place 
of learning, not a corrective institution, and insist that rec- 
lamation of a weak or wayward youth is not the university’s 
job, They declare tliat education is a privilege, and that the 
university is doing a real job of education for the many when 
it firmly sliovvs how privileges may be lost to those who prove 
by their conduct that they do not deserve them. 

Especially is this apt to be true of smaller institutions which 
are located in sudi little towns that everybody, townspeople 
and students alike, knows when John Smith spent the night 
in jail for being drunk. What kind of a boy he is, why he got 
drunk, and how he may behave thereafter apparently cannot 
be of as much concern to the university as what the students 
and townspeople may think if John isn’t punished, and the 
campus made aware again that the "wages of sin are death,” 
In maintaining cordial public relations in the town and re- 
spected standards on the campus, it is sometimes hard for the 
university to remember that it must also maintain its responsi- 
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bility to its iiuiiviiluai stutU’nf*< Once ;i stuJetu has been 
accepted, the university assunies a ilcfinirc r»hliiTation to help 
him, even uheti he makes snistakes. m Ins adjustment to his 
new environment, and in histpiest lor the kind of" an education 
that will artord Itim masiimmi improvement in every area of 
his pcrsmial as well as his intellectual development. This 
fddiijation assumes that the welfare t>f‘ the individual will not 
liesacriHicd wlien he pets inin trouble, l’t»r pettitut intet trouble, 
and I'cttinp nut of it ate parts itf file learning pian ess which train 
youny people fmw tf» live and work in yretiter harmony and 
peace with each tither. Careful therapeutic discipline can 
help the indiv idual effect this reorijani/aticm of his behavior 
attitudes wdtliout damaninp the morale of his contemporaries. 

Socioloyists have made studies to aseertaln the effectiveness 
of punishment in deterriiip ilelimjuent or anti social behavior. 
The findings of these studies tend to prove that whereas punish- 
ment may cheek petty ami minor irrepularitics, it has little 
effect in climiiiatinp .seriously objectionable behavior, It docs, 
however, have noticeable elfeet in making people cautiuvis and 
more deft in the art t»f not ycttini» caupht, 

Walter C. Reckless in his lanik CHntitia/ Behavior* .st,ite.s; 

While punishment for dcterreru'c .ipjK'.irs to U’ lnnically efli- 
caciuus, tlieie is considerable iloubr that it Ii.is as much deter- 
rent value ;is the justificattoii presupposes, Kven in the era 
when extremely severe pimishnicnt was vtseti for crimes of 
niiiior imiuirtariee, no evidence can lx* found to support the 
view that punitive nie.isures marerially eurrniletl the volume 
of crime. . . . 

Knr the great mass of infractions of law, the fear of conse- 
quences or the fear of iiunislimcnt probably enters very little 
into causation. The conception of deterrence presumes that 
the iKmson tliinks before he acts, and tliat all he has to do is to 
think of the conscquetiecs; and then he will Ik- tlcterred. .^Veiu- 
ally, however, individuals Ivcliave, act in certain w.iys, get 
involved in certain activities without the fe.u of punishment 
k'ing held upjK’niiosc in mind. 

Many institutions tire uneasy and unhappy about their 
disciplinary prucedurc.s. Tiicy believe in the sanctity of the 
individual, yet they must protect the welfare of the whole 

^Reckless,, \Y«lier C. Cnmuttil Behatuir Xcw York Hilt Book Com- 

puny, 1940, p. 27.1 
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student body. I’bcy recognize that an education includes 
emotional and social maturation, so they endeavor to furnish 
those curricular and extracurricular opportunities which 
make it possible for a student to learn how to live acceptably 
with Ids peers in conformity with those social and ethical 
restrictions which are necessarily essential to the well-being 
and survival of his gtoup. They know the frailties of human 
beings, particularly of youngsters who are trying through ex- 
perimentation, trial and error, to build self-confidence and a 
sense of personal security They hope their educational pro- 
gram will assist their students in attaining this sense of ade- 
quacy by guiding them to a lealization of their weaknesses, 
and an understanding of how to correct them. They know that 
therapeutic discipline is part of this process. 

Why, then, do not more institutions administer this type of 
discipline? For one thing, they may not have enough money 
to hire a staff of psychologically trained experts as disciplinary 
counselors. 'I'hcy may not have a mental hygiene clinic to 
furnish psychiatric diagnosis and treatment. They hesitate 
to prescribe treatment for an individual if they have not a 
clinical psychologist, who cannot only uncover the obscure and 
often deeply hidden causes of his trouble, but then work with 
him in correcting these traits. Or, in the last analysis, they 
may not know exactly how to go about exercising their dis- 
ciplinary functions in an educative and therapeutic manner. 

Whoever has this responsibility, and it may rest solely with 
the President, or be vested in tlie Dean, or a special committee, 
and whatever the practice may have been heretofore in ad- 
ministering it, discipline can be one aspect of the educative 
function, and it can become a constructive counseling ex- 
perience for the student concerned without the expenditure 
of additional funds, or the acquisition of additional staff. A 
university is fortunate if it can afford to hire specially trained 
experts to handle its disciplinary problems. PTowever, the 
many universities which cannot afford to do this can and should 
take account of their immediate resources, and should use their 
best qualified personnel in establishing a functionable, thera- 
peutic disciplinary procedure. 

First, and foremost, the President and the Faculty may need 
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(o be iiidm tjinatrd am! iiiiiniml wish thr miiu-atinmil concept of 
discipline, rrulrrstandim’ this, rhey may iimJ he encour- 
aged to place rlu' administering' of ilisi'iphnf' in the hand.s of a 
group of rluise faculty iiirinhers and students who archest 
fitted by training, ability, willingness, anti interest to devote 
their consecrated etlort to a tarefu! performance of this duty, 

Having \'cKted thm .uithority where it can best function, the 
Fiiculty should then not take issue with the ai tion.s and deci- 
sions o( this hoanl. 'I'he ho.ird sltotild have ample oppor- 
tunity to try out its j'oliiies and ptmetlures unliamjteral by 
advice or criticism 

It is desirable to have the Director of Student Affairs, or 
one of tile Deans of Stiulents serve as .i non-voting member on 
this board, I 'sually this is the per.son who lurni.shes, in casc- 
study form, most of the pertinent data concerning the character, 
personality, and backgroutid of the offender, and who come.s 
before the Imard as the one best tpialified to help that group 
thoroughly understand the student. After a decision is 
rendered, this is the person who help.s the offender to ctmiprc" 
bend and to accept the verdict In fact, in some universities 
he ha.s to handle every phase of discijdine by him.self without 
the help of any committee. 

Not only must the b’aculty he etUicated tci think construc- 
tively about di.sdpline, hut the student hotly must at die same 
time have its attitudes toward discijdinc reshaped. If 
John Jones does not get kicked <iut for breaking a store window 
while he wa.s drunk, the stiulents fiml it liillicult to understand 
why John Brown .should he suspeiuled for u.sing his car without 
a ])ennit. They, too, need to be trained to consider discipline 
as a learning proce.ss with penalties levied to fit the Individual 
rather than the crime, 'Diey need to realize, and be glad of the 
fact, that a .student in trouble gets every consitieration from the 
disciplinary board, aiul they must understand that the hoard's 
decision i.s based uimn its complete knowledge of the individual, 
and all the extenuating circumstances surrounding the case ■ 
knowledge which cannot he made available to otlicr.s. 

They need further to reali/e, if su.spcnsion is the verdict, tliat 
suspension is probably the be.st way tlte offending student can 
be helped to adju.st more maturely to his responsibilities in the 
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world of which he is a somewhat confused member. They 
need to learn liow to accept the action of the disciplinary board 
without gossip and condemnation. All this takes time— time, 
and careful, patient guidance. 

The final step in this establishing of a functionable, thera- 
peutic disciplinary procedure is the actual procedure used for 
the handling of eacli case. This should be so designed that the 
individual is afforded a maximum amount of guidance and 
protection, and it should be standard practice. 

First of all, the student concerned should be interviewed to 
obtain from him his statement of what occurred and why. 
The accuser, or whoever reported the misbehavior, should 
likewise be consulted for clear and accurate information about 
the specific nature of the particular offense. Occasionally it 
IS possible that the accuser has acted in rancor, or for spite, or 
for personal reason.s involving prejudice, or malice, or gross 
misunderstanding. All of this must be known, everything 
possible about the case must be thoroughly compiehended, for 
sometimes tlie stutlent must be protected as well as helped. 

'rhe agent who works with the student in this sort of an 
organization is actually a counselor, and he functions better 
if he has had siiecific jisychological training in the techniques 
and skills of interviewing, diagnosing, counseling, and therapy. 
It is liis jol) to explore with the offender the nature of his of- 
fense, and the jiersonality traits, and emotional factors which 
contributed to it. He must help the student understand why 
lie behaved iivS he did, and at the same time he must create 
for the offender such an atmosphere of acceptance and security 
that tlie student will be encouraged to want to function more 
satisfactorily within the established social framework of which 
he is a part. 

This counseling process is of itself therapeutic, for it helps to 
maintain the self-respect of the student, When a person is 
in trouble he needs tlesperatcly to be certain that he is not going 
to be rejected by his peers because of his misconduct His 
acceptance by his counselor is reassuring, and gives him the 
courage to face himself, his troubles, and his associates. As 
he talks with his counselor, and brings to light the many con- 
flicts which may have beset him, perhaps since early childhood, 
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he bei'ins m s>ee hnw vanous pre-isurcs have huilf up, and how 
his behavior has liccii ermdirhined !)>• his rcpcateil reactions to 
diese forces With such insiuht comes an apj»reciation of the 
dynamics of his present lomluct. ami tjcnerally a determina- 
tion to want to change it to wavs more acceptahk* to his fellows 
and to himselJ. 

'rhis is not an Jiistanr j^rtKcss. The counselor urilizcs every 
avuilahle source to aecuiiiulate helpful informatirm ahout the 
student. InteHii'eiue and aehievement test sCf»res are .studied, 
'rhe student’s scholastic pi-rformaiuc is examined in the light 
of these scores. Oftentimes the tremendous difrerenee between 
perfornuinee and ability i!idie.ues the presence td' anxieties 
worth inve.stigatinu. 

The Head of Residence, the Faculty Adviser, the student’s 
various instnn tors, and his Fraternity .Adviser ate consulted. 
If individual personnel recoixis are kej't tliese are carefully 
explored for person.d hi.storv which may add to the counselor’s 
uiuler.standiis/ of rlie abiliry. personality, and developmental 
huckgroutul of the student. Repcaletl interviews with the 
student take place interviews wliich are continued long 
enough after insights have been obtained to make sure that the 
individual is .seenrely .started in his proce.ss of rehabilitation. 

Kvery availuhle resource is tapped in ihi.s proee.s.s, The 
Health Serviee e:m indicate whetluT health hazarths liave con- 
tributed to tlic student’.s difhculties, and if .so, how they can 
be improved or eliminated. The mental hygiene clinic can 
diagnose whether the imlividual may be neurotic or psycho- 
pathic, and can furni.sh .specialized p.sychiatric treatment if 
it is indicated by the diagntwis. Teachers can be encouraged, 
if necessary, to use different classroom tactics with the in- 
dividual. Opportunities for developing greater .social com- 
petence and a corre.spondinu sense of responsibility can be 
provided. 

If discipline is really educative and follows a therapeutic 
jiroccdure, the offender will not he scolded, ritliculcd, or de- 
nounced for his misdemeanor, no matter what the offense may 
he. If the misconduct i.s such that actual penalties have to be 
invoked, care should be taken to make .sure the .student com- 
prehends why the penalties have been prescribed, and why 
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he must submit to them. If suspension is the only verdict 
available the student must be helped to understand why the 
university cannot condone his conduct, why the existing 
disciplinary set-up does not permit any diflFerent handling of 
the case, and why the university regrets having to dismiss him. 
Penalties will not be inflicted merely as standard procedure but 
when they are invoked they will be chosen as a definite part of 
the therapy. They will not be a punishment for a certain 
crime, but a benefit for a certain individual. These steps m 
themselves are constructive, and are an investment in future 
sound public relations as fai as the university is conceined, 
As far as the individual is concerned, such treatment leads to a 
better emoticmul adjustment, and the preservation of self- 
respect. 

Cooley has stated that the community is extiemely unwise 
to take any action tliat will destroy the self-respect of the 
offendeti^ ami Van Waters asserts that the self-respect of the 
offender is the basis of all successful eflforts toward his rehabili- 
tation.* 

After the di.sciplinary board has finished with its hearing 
and its verdict, tlie student cannot be left alone to flounder. 
It is preferable to have the one who has worked with him so 
far as a counselor continue in that capacity, but if this is im- 
possible the student should be referred to some sympathetic, 
sensitive, competent staff member who is willing to serve as a 
friend and guide, whetlier the student stays in school or leaves 
on suspension. If the offending student needs a type of 
specialized therapeutic service which is not obtainable at the 
university, he should be referred to proper agencies nearest his 
home, and be removed from the university until improvement 
in his condition is indicated. 

To summarize what has tlius far been stated: Many col- 
legiate institutions still prefer the old concept of punitive 
discipline to the newer philosophy of therapeutic correction. 
Some of those institutions which cleave to the punitive attitude 
do so because they feel tlic penalties they inflict on the in- 
dividual tend to safeguard tlie entire student body as a whole, 

‘ Cooley, C. H. Life and the Student. New York: A, A. Knopf, 2 ^ 4 - 

‘Van Waters, Miriam, “The Dellquent Attitude,” The Family, V (1914), m 
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atiti keep tlir iiiajoiit) innrt- utmpicrfly uiulcs' miurul. Others 
lio so lifc.ivisi* tliJN uu'tiuni invttivcs less work than the case 
study, tIuTapeutit approach Some institutions excuse their 
lack of corrective pnttcdure on the jjromuis that a staff of 
experts is a financial inipo^sihilit) 

However, an increa‘;inp nuniher of universities arc adminis- 
tering their discipline as a hmetion of their educative process. 
If fuml.s are available, their orpani/.itinn is .staffed with p.sycho- 
logically trainial specialists. If funds are .scarce, the best of 
their regular personnel make certain that all offenders get a 
chance at rchahilitation under some sort of guidance. 

If a university believes in the thetapeutie disciplining of its 
misbehaving students, it will find a way to help them profit 
from their mistakes, and .uijust to better behavior habits. 
If a tinivcr.sity dias not recoitni/e any sudi rcspon.sihility to- 
ward it.s offeiuler.s, then the guilty ones can expect to be pun- 
itthed in a inannei bclittiiut tin* trouble they have caused. 

Four frediiiicd nr Imtli mie Safuiday ntglit iii tjue.se of 
lull .nul advc'iiftnc. 1 licy dnin't li.ivc ij.io-, fill tlicir ilurmi- 
fdiy d.mcc. ‘.M thc> dcialcd fn U" a iicighlioriiig town, and 
explore Htiiiie nl (lie gsit I iii\ knew liiat iiMiig Ned’s 

c.ir for such .ij. nun w.e. cnntr.iiy Oi univer'.irs legul.itions, hut 
who wmild evei find out alKuii it.-’ 

I..vte Suiukiy afterntHtn one of the-e boy, jtlumed long dU- 
raiicc from the police '.tation where tliey h.id all sjient the 
night, imd humbly asked the He.m of Stutienrs if he eould pos- 
sibly get them out of jad. TJie Dean uent, to thar town, con- 
ferred with tile Chief oM’olice, Mgin-ti for tlie four Iniys, and 
hiought rhem home. Two d.ivs later lie went to court, and 
.stooti IkToic the jutlge with them while they were tried on 
ch,irgc.<! of disorderly conduei aiul grand hirceny. They had 
aiipropriated as souvenirs some e\i>t:iisivc bar equipment from 
one of the "joints” they had visjtes!, and .ill of them had con- 
sumed too much Iicei anti whiskey 
^Vhen the judge disinjsseti a!! charges ag.div,t tiiem .uul put 
them on probation for one year n* the Hean of .Stmlents, he 
exjdained that where.is he did not condone their conduct one 
liit, lie did recogni/e thar they were immature ytnjiiusters wlio.sc 
jioor jutlgmcnt had landcil riiein m the liamh. of the hiw. He 
didn’t warir tlicm to have a Ciiiiif conviction, ibr he was sure 
their exjierienee would keep them fnmi becoming rejH'atcr.s. 

The judge was correct. Their st.iy m jad had been tli.sturb- 
ing innu sobering. All of them had regiettcd exceedingly their 
mdiscuition, .and each of them had iletermined never to get 
into any mess again. 'I'hcy were ashamed arui humiliated. 
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Wlicn tliey iippeiircd before their university disciplinary 
committee, their heads of residence, their advisers, the 
Dean spoke in their belialf. They had been excellent campus 
residents, and they were all fine lads A plea was made that 
they lx; allowed to continue at the university on probation to 
the Dean or some othci leliable staff member. They were all 
.suspended for the balance of the semester, the faculty members 
of the committee outvoting the student members, who held out 
for probation. The decision was purely punitive, a far cry 
from anything oonstmetive or therapeutic. 

Unfortunately, when students come before disciplinary com- 
mittees to make restitution for the commission of sins, such 
verdicts still happen too often, and in too many institutions. 
"Madame LeFarge” again sits in session, and there is knitting 
at the guillotine. 
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ERRATUM 


Tlie first two ■tentencc! of the second paragr.inli, page 174, of C. H.irold Stone’s 
article, "Are Vocational Orientation Courses Worth tiicir Salt?" which appeared in 
the Summer (1948) issue of this journal, should he revised to read. “Eor counseled 
students, trends in the laboratoiy groups (Expel imental ]I and III) were in the same 
direction as for the lecture group (Experimental I). However, fewer liiboiatory stu- 
dents who were not counseled had jioor choices at the end of the year and there was 
an increase in optimal choices during the year,’’ 



QUESTIONING SOME ASSUMPTIONS UNDERLYING 
CURRENT ACHIEVEMENT TESTING 


VERNRR M. SIMS 
Uiiiveriity of Alahama 

The value of any measurement of educational achievement 
must be judged ultimately in terms of the extent to which the 
measurement reveals information leading to a more intelligent 
prediction or control of the behavior of students. Commonly, 
however, we neither apply this criterion directly to our Instru- 
ments nor to our measuring activity. Instead, in the testing 
which we do, we either consciously or unconsciously accept a 
chain of assumptions which stem from and presumably may be 
justified, either logically or experimentally, as supporting this 
ultimate purpose. The soundness of our measurement and its 
usefulness to education is, therefore, contingent on the validity 
of a set of assumptions which are implicit in our testing. It is 
the purpose of this paper to make explicit and to critically ex- 
amine certain of the assumptions which seem to underlie current 
measurement of achievement. 

I. Current measurement of achievement assumes that the ^ 
value of a learning experience is indicated by increased ability 
(skill or knowledge) to cope with some situation or class of sit- 
uations. 

Achievement testing as presently practiced appears to be 
confined to the testing of ability. Standardized tests of achieve- 
ment, whether subject tests or general tests, survey or diag- 
nostic, whether tests of knowledge, skills, or understanding, 
or tests of ability to apply principles and interpret data, are 
all concerned with measuring what children can do. Teachers 
in their own testing and marking are concerned with measuring 
the same outcomes. If the teacher does attempt measure- 
ment of anything other than ability it is usually made clear to 
the pupils tlut "this test does not count." For teachers to 
permit anything other than achievement (Interpreted as in- 

S^S 
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creased knowledge or ability) tcj influence their marks is com- 
monly considered questionable practice. 

> The obvious conclusion to be drawn from an examination of 
current achievement testing is that the end of education is to 
increase the abilities of pupils. Most of our educational theor- 
ists would not be willing, however, to accept any such con- 
clusion. They would say, rather, that the end sought in 
teaching is changed behavior on the part of the learner; which 
is, of course, not the same thing as having the ability to do 
differently. Whether one ivill act so and so depends not only 
on whether he can do so but also on a complex of attitudinal- 
emotional-motivational factors w’hich are generally neglected. 
Furthermore, it seems reasonable to assume that whether the 
learner will use his learning or not is a factor of tlie setting in 
which it is acquired. Not only the learner’s own purposes 
and methods but those of his teacher will condition the kind 
and amount of use made of the learning.* 

If the fundamental question in achievement testing is 
whether, in terms of the evidence at hand, one can pretlict that 
the learner will act differently in a certain class of situations, 
it would seem desirable that our testing comprehend more than 
the measurement of aHlity. Recognition of this atssumption 
and acceptance of its limiting influence would, in the writer’s 
opinion, lead to a re-vamping of many of our present ap- 
proaches, to the designing of new instruments, and to a re- 
interpretation of many of our test findings. Tests might be 
designed, for example, to measure whether a child would, as 
well as could, read, reason or act in certain types of situations. 
Measures of the effectiveness of the use made of learnings might 
be developed. In time wc might be able to describe (even 
quantitatively) the conditions under which learnings would or 
would not function. 

> 2. Current measurement of acliievement assumes that the 
value of a learning experience is indicated by growth in those 
directions toward which the learning (or teacliing) activities are 
specifically pointed. 

'The writer has developed thl.s point at con.iiidcrnblc lenath in nn earlier article, 
"Educational Measurements and Evaluation,” Jounml oj Julitcalioml Research, Sep- 
tember, 1944, pp. i8--a4. 
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It seems fairly obvious that this assumption does underlie 
our testing. Typically, we test the value of drill in spelling by 
measuring the increase in ability to spell, the value of instruc- 
tion in liealth by measuring the increase in knowledge and 
understandings relating to matters of healthful living, the value 
of a method of science instruction by measuring the increased 
ability to apply scientific principles, etc. We measure the 
child’s growth and mark him on the achievement of the specific 
objectives which are set up for the course. 

Superficially the soundness of this procedure would seem 
almost axiomatic; but the thoughtful reader will recognize im- 
mediately that it is justified only when many other things are 
accepted as “being equal,’’ and without evidence to support 
this, one cannot always assume that such is the truth. If the 
increased ability to spell comes as a result of sacrifice m the 
ability to read, if it is accompanied by the acquisition of un- 
favorable attitudes toward spelling or toward school, if it fur- 
nishes an escape from real problems about which the children 
could and should be doing something directly, or if it merely 
results in pupils becoming increasingly better in a skill in which 
they are already good, one would certainly question the value of 
the learning experience. Yet evidence relating to such matters 
is commonly not made available Such information is usually 
not even considered the concern of the tester. 

If the “whole child” is involved in any learning experience, 
then inferences concerning the value of learning which ignore 
this fact are of questionable validity. Testing theory which 
neglects the fact forces the trained user to interpret his test 
results in conjunction with a large amount of “common sense,” 
subjective and informal data, and encourages the untrained user 
to arrive at conclusions that are unsound. 

3. Current measurement of achievement assumes that the 
value of a learning experience may be inferred from meas- 
ures of the outcomes evident at some particular moment after 
learning, typically at the conclusion of a learning experience. 

The test-teach-test formula describes the accepted procedure 
for evaluating the outcomes of learning. In practical classroom 
situations and in educational experimentation we test the value 
of method and the growth of children in such terms. Progress 
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is assumed to be measured by noting the difference between ini- 
tial and terminal test scores. Furthermore, in cases where 
there has been no previous formal training the first testing is 
p. commonly dispensed with, and the terminal test score becomes 
the measure of learning. 

We do this although we know that learning is a form of 
growth the path of wluch is best expressed by a curve. If this 
is trae, predicting later performance is a matter of projecting 
this curve into the future. We attempt to do this extrapola- 
tion by locating one point (in the case of terminal testing only) 
or at the best two points (in the case of initial-terminal testing) 

> on the curve. Mathematically, this is not possible. With one 
point we can tell nothing about the curve, with two points the 
curve would need to be a smooth one the slope of which vere 
known. These are comlitions whicli are not met In practical 
teaching-testing situations, unless in the doubtful case where 
the concern is entirely with group averages. Certainly no in- 
dividual’s curve of learning is a “smooth one the slope of which 
is known.” This implies that dependable predictions can be 
made only when we locate further points on the curve of growth. 

Some educators will point out, however, that there is a corre- 
lation between such measures ofiirngrcss and later performance. 
The fact is, the nature of these correlations is one of the reasons 
which cause the writer to question the soundness of this as- 
sumption. The size of tlic coefficients usually fount! between 
terminal tests and later achievement suggest that wc may be 
dealing with little more than “the correlation between desir- 
able traits,” Reading age, at ten years, for example, is no 
more closely correlated with reading ability at 15 years tlian is 
general intelligence. In the writer’s institution at least, termi- 
nal achievement on a standardized test of high-school algebra is 
not as closely correlated with success in college algebra as is gen- 
eral quantitative ability as measured by the ACE Psychological 
Examination. One is led to suspect that the only real justifica- 
tion for assuming that initial-terminal testing measures the value 
of a learning experience is found in the convenience and sim- 
plicity of the procedures wliich the assumption makes possible. 

> 4, Current measurement of achievement assumes that the 
only sound interpretation of measures of achievement is through 
comparison with norms of some sort. 
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Educational jneasuremervt, as it has developed, is a “norma- 
tive science, that is, it attempts to develop norms of perform- 
ance for groups of known (and described) status from which 
one may by comparison interpret measures of other groups or 
individuals. Standardized achievement testing is universally 
of tliis nature. Raw scores are to be interpreted in terms of age 
or grade norms, T-scorcs, scaled scores, or percentiles. The 
writer kno\v.<5 of no standardized achievement test which does 
not use this method of interpreting scores. In fact, the word 
“standardized” has come to refer not only to a standard test- 
ing procedure but to a test with “standards.” Furthermore, 
very few tests propose any other method of interpretation. In 
teaclier testing, too, the emphasis, as the testing experts would 
have It certainly, is in the same direction. In all text books 
concerned with the problem of marking with which the writer 
is familiar, teachers are encouraged to make relative interpre- 
tations, to “mark on the curve,” to define an A as superior per- 
formance in the group; some even go so far as to recommend 
that [iromcjtion and non-promotion be determined on the basis 
of po.sition in some group. Any teacher who proceeds other- 
wise today is apt to be labeled either old-fashioned or too 
“progrc.ssive.” 

The writer is not questioning the value of the interpretation 
of test scores in terms of norms. In the hands of a trained 
teacher, standard scores may serve many useful purposes. 
(The fact that they are too often misused, being accepted as 
goals of achievement, for instance, is also irrelevant to our 
purpose here.) Relative position in a class, as expressed by the 
kind of marks which specialists in measurement advocate, also 
has its uses, Tliat which is being questioned is the assumption 
that the only valid interpretation of measures of achievement is 
through comparison with norms. For many school objectives 
and for many .situations facing teachers, the writer contends 
that there are other perfectly valid interpretations possible and 
desirable. There are two cases in particular which seem worthy 
of comment, 

First, in the case of some learnings, worthwhile interpreta- 
tions may be made by comparing a child’s performance with the 
demands of life (present or future). For example, we assume 
that a child needs to know how to add, and to know automati- 
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cally, all the digit combinaticms. The fact that Johnny has 
mastered 50 per cent of these comhinations, or 60 per cent, or 
90 per cent, is valuable information for the teacher wlio is work- 
ing with Johnny without regard to wdiere he stands with refer- 
ence to other children. In fact, tlie job which lies ahead for 
Johnny is just the same whether he i.s at the top, in the middle, 
or at the bottom of some group. Or, let us consider writing 
or spelling. Johnny mu-st write legibly (we a.ssume), and 
whether his writing is legible, or not, can be determined without 
comparing him with other children. If wc a.ssume that the 
child should he able to spell the 1,000 most common words, or 
^ the 100 “spelling demons," then knowing that he can spell 
certain of these words has great meaning to Johnny and to his 
teacher, even though he is tlie only pupil .slie has ever had in 
class or even known. If there i.s anything wrong with this idea 
it is in the assumption concerning what he should know, not in 
the interpretation of the mea.surcmcnt. 

Our whole system of prerequisites falls into the same cate- 
gory. If certain learnings are really needed to succeed in later 
work then tests which show whether the student has masteied 
these learnings have meaning which is independent of the per- 
formance of others. The same is true of learning in multi- 
tudinous fields. Particularly in the fields of attitudes and 
habits of action could illustrations be multijilied. The fact 
that a child throws rocks at Negro children every time he gets a 
chance, the regularity with wliich he bru.shes his teeth, or the 
extent to which he eats a balanced diet, all have meaning wliich 
is not determined by a normative .score. 

Secondly, many measurements may have meaning when 
interpreted in terms of the student’s own educational-psy- 
chological make-up. Illustrated simply, the child who succeeds 
in mastering the mechanics of arithmetic hut who cannot solve 
problems involving the same processes can he located without 
any normative interpretations. The .stiulent whose factual 
learning is entirely acceptable to rlie teacher hut whose atti- 
tudes toward the same problems arc not; the student who.se 
emotional blockings prevent him from using Ids ability to reason 
sensibly on problems relating to labor unions ; the student whose 
motivations are all in the direction of pleasing the teacher; 
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I'hese can all be identified without the use of norms, whether 
class norms or large group ones. The fact that the teacher’s 
own experiences with students are involved in the judgments 
which .she makes concerning the goodness or badness of such 
characteristics i.s aside from the point. Exactly the same value 
jiulgments are involved in the interpretation of tests which are 
provided with norms. 

Insisting that measures of achievement have meaning only 
through comjiarison with norms must result in limiting the 
usefulness of ctiucational measurements. 

5. Current measurement of achievement assumes either that 
“appropriate” measurement is independent of one’s theory of 
learning and of education, that current measurement concepts 
fit all current theories of learning and of education, or that there 
is only one acceptable theory of learning and of education. 

When achievement testing techniques were first subjected to 
careful stuily, some three decades ago, the prevailing theory of 
learning was a narrow, “connectionist” one, expressed by 
Thorndike’s .stimulus-response formula, and the commonly ac- 
cepted theory of education was that education is preparation 
for living. It is perhaps no accident, therefore, that our test- 
ing procedures so aptly fit these theories of learning and of 
education. In the meantime, however, in many quarters at 
least, otlier theories of learning and of education have come to 
be accepted, while our testing techniques remain relatively 
unchanged. ('Fhe only major change in achievement testing 
procedures that has taken place during the past two decades 
which the writer I.s able to identify is represented by Tyler’s 
approach. Most of our testing seems to fit the theory that 
education is an accumulation of large numbers of relatively 
independent knowledges and skills, while Tyler’s testing would 
.seem to identify it as an accumulation of a large number of abil- 
ities to apply principles, interpret data, and reason logically, 
all of which are still relatively independent. It is not difficult 
to see in Tyler’s work the influeiice of Judd’s theory of “trans- 
fer through generalization” rather than Thorndike's “transfer 
of identical elements,” but otherwise it fits perfectly an atomis- 
tic conception of learning as preparation.) 

So far as the writer can find, no one working in the field ot 
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achievement testing has sericm.sly cnnsiiiered the implications of 
Insightful learning, or of organismic or “field” psychology for 
achievement testing proredvires. Nor does anyone seem to 
have considered the possibility that other thetiries of edliea- 
tion, such as the theory that education is a form of intelligent 
living which within itself constitutes* an end, may demand dif- 
ferent approaehes to the matter of testing. 

If one rejects the theory that learning comsists of the acquisi- 
tion of a large number of more or less simple and independent 
abilities, then one can justify present means of testing the out- 
comes of instruction only by assuming that the numlier of such 
abilities acquired is indicative of total learning. When the 
fundamental nature of the differences among the several 
theories of learning and of cilucaiion is considered it seems 
rather naive to accept such an assumption without any evi- 
dence to support it, even without trying to gel eviiience to 
support it. Can we assume, for example, that a child who 
showed no progress on a current stamlardized reading test 
during his first three years in .school, and then, in his fourth 
year, without any special help, junipcal from a reading age of 
seven years to almost eleven years, aclually learned nothing 
about reading during the first three years?® How could one 
who denies that psychologically the whole is equal to the sum 
of tile parts be expected to take to current rests of arithmetic, 
of social studies, of science? As long as we operate as tliough 
the end of education is the accumulation of a set of skills and 
knowledges which will be useful l.Uer, can we blame the “pro- 
gressives” (who accept a quite different theory of education) 
if they reject our instruments in their entirety? 

It does not seem unfair to say that the measurements ex- 
perts have very subtly, although perhaps unconsciously, thrown 
their support to a particular theory of learning and of education. 
Would not an eclectic approach contribute to a greater serv- 
iccableness from the discipline? Wiih our present lack of effort, 
can we presume to say that educational measurements linvc no 
contribution to make to those who hold to differing philoso- 
phies of education or belong to differing schools of psychology? 

’ Reported by Willntd C. Olson, "When Should My Child I.e.nrn to Read?", Uni- 
vmity oj Michigan School of Education Biil/elin, XIX(i547), g. 
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In summary, the attempt has been made in this paper to 
point nut several assumptions which seem to be implicit in 
present-clay measurement of achievement. The assumptions 
identified are those of which the writer is critical. In general, 
the ba.sis of the criticism is the fact that through operating on 
the assumptions we restrict the usefulness of educational 
measurements. Whether or not the assumptions are defensi- 
ble may, of course, be debated. If they do underlie our 
measurements, however, there can surely be no question con- 
cerning the worth of making them explicit, and the desirability 
of consciously recognizing them as assumptions. It may even 
be that simply accepting the assumptions for what they are 
would, in itself, result in some rather fundamental changes in 
our measuring activity and in the techniques of measurement 
finally developed. 




SRT,P:CTI0N of physical SCIENTISTSi 


Mll/roN M. MANDKLL .md SIDNEY ADAMS 
U. S. Civil Service Commission 

'rm; development of valid methods for the selection of 
scientists for industry and government is a must project for 
those engaged in personnel selection. All nations have learned 
that the status of scientific inquiry is an important ingredient ' 
of both national defense and prosperity. All of our scientists, 
military, industrial, and university, contribute to these im- 
portant goals. 

Little evidence of a statistical nature exists regarding the 
validity of methods currently used for the selection of physical 
scientists for employment. Universities have studied the 
question of predicting scholastic achievement in the physical 
sciences, There is little or no evidence, however, to indicate 
that the te.sts used for rhis purpose will predict employment 
success. 

The United States Civil Service Commission began on 
November i, 1947, a study of selection methods for physical, 
biological, and agricultural scientists. The President’s Scien- 
tific Research Hoard, in its report of October 4, 1947 on 
Administration Jor Research, had recommended that “The Inter- 
departmental Committee on Scientific Research and Develop- 
ment should sponsor a series of studies to be carried out by 
departmental personnel staff and Civil Service Commission staff 
relating to the broad problems of , . examining and testing 
techniques for scientific positions . . (p. 171). Following is a 
preliminary report on the work done during the first six months 
of this project. This introductory statement has been pre- 
pared now in the hope that the information contained in it will 
help to stimulate additional work by others in this field. This 
report is limited to a discussion of selection methods for physi- 

' 'TliysicftI .scientLsts” for the purpose of this article include physicists, chemists, 
and research engineers. 
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cists, chemists, and research engineers; it docs not include any 
duscussion of Iiiological and agricultural scientists. 

Jt)k . luatysis 

Information regarding the duties of phy.sical scientists was 
obtained by the use of the following methods: (i) Discus.sion 
with leading .scientists in the Federal (government; (2) review 
of the available literature; (j) review ctf classifictition speci- 
fications for physical .scrence p<isition,s; and (4) preparation by a 
small gi'fuip of phy.sical .scientists of written statements describ- 
ing their duties. The ftillftwing tentative test battery was 
based on the infcirmaticm obtained from these four sources. 

'lest liuttcry 

I’lie following tests were used in the altemirt to measure the 
abilities indicated as essential by job analy.sis. No profound 
analysis Ls needed to ilctermine that other skills ahso need to 
he measured, in addition to tho.se presumably measured by 
these tests. 

I, Abstract Reasoainy; {Figure //?/«%/«). ' 'I'liis fivc-cholce 
test attempts to measure ab.siract reasoning ability. It has 
been widely used by the Unitcil States Civil Service Commission 
for entrance level professional and administrative positions; 
the results obtained have been con.sistently good. 

a. Gottschaldt Figures. - 'riiis is a revision by rrofe.ssorL. I., 
Thurstone of items originally developed in Germany, The 
factorial composition of this test, which requires the detection 
of hidden geometric figures, has not been fully determined. 

3. Spatial Fests - -The following types of spatial items are 
now under study: (a) Cube turning; (b) surface development; 
(c) two-cube (two separate cubes with various designs on their 
faces are presented; one cube has two prongs extending from 
one face —the other cube has two holes on one face; the task is 
to determine which one of a number of sets of two cubes joined 
together would be formed by the two separate cubes if the 
cubes were joined by placing the prongs of one cul)e in the 
holes of the other); (d) block formulation (the task is to de- 
termine which one of a number of large blocks would be formed 
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by the combination of a specified number of three sizes of 
blocks)^; and (4) block counting. 

4. Mathemnticul Formulation . — The task in this test is to 
express a narrative statement in terms of an equivalent mathe- 
matical formula 

5. Letter and Number Series . — ^This test was included with 
the thought that the reasoning ability measured by the test 
might be important. 

6. ‘Fable Reading . — This test was developed by the Air 
Forces. It was administered in this study as a speed test (7 
minutes). 

7. Verbal Analogies . — The inclusion of this test, which at- 
tempts to measure verbal and reasoning abilities, in the bat- 
tery wa.s suggested by Dr. M. H. Trytten of the National 
Research Council, who is Chairman of the Civil Service Com- 
mis.sion’.s Advisory Committee on Scientific Personnel. 

8. Interpretation of T)ata.—T\\\s test, devised by the Pro- 
gressive Education Association, measures the ability to evalu- 
ate the accuiacy of conclusions from statistical data. This 
test was scored by two methods: (a) The number of items right; 
and (b) the direction of the errors, that is, whether the errors 
tended to represent cautious or bold evaluation of the state- 
ments. 

g, nypot})cses.-~'V\\c task in tins test, devised by Dr. Max 
Kngclhart of the Chicago City Colleges, is the evaluation of 
the relation of facts to hypotheses, and the relation of hypoth- 
eses to the explanation of physical phenomena. This test 
has a higli degree of face validity in selection work in the 
physical sciences, 

10. Scrambled Sentences.— L :\\z task in this test is the de- 
termination of what the final word in a sentence would be if 
the words, which have been disarranged, were put back in their 
original order. Sentences about 15 words in length relating 
to the physical science field were used in this study. 

n . Biographical Inf ormation Blank . is general agree- 
ment that interest in and enthusiasm for research work are 

”^This~tcst was developed by B, J. Winer, formerly of the Test Development Unit 
staff at the Civil Service Commission. 
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essential ingredients of a successful career in the physical 
sciences (and other occupations also). 7 'hc items in the BIB 
attempt to measure these trails as well a.s schooling and per- 
sonal relations. Most of the items had originally been de- 
veloped by the Department of the Army for military selection, 

12. Reading Comprehension. -'Phesc are paragraph-reading 
items from the general science field. Proper interpretation of 
reports of scientific studies wouUl seem to be an important 
skill to measure in this study. 

14. Science Judgment. 'Vhh test is still in the process of 
development. It attempts to measure judgment in terms of 
such problems of science methodology as the de.sign of experi- 
ments, and the interpretation of .scientific findings. Its con- 
tents cover the field of the physical sciences ; it docs not attempt 
to be specific in terms of fine or another subject. 

1^. Subject-Matter.' - 'i'wo subject-matter tests have been 
prepared, one in the broad field of phy.sic.s and one in chemistry. 
Because of the lack of staff to prepare a test in engineering, 
the physics tc.st has been used as the subject-matter test for 
this group, 

16. Focabulary.- 'I’hc items arc general ratlicr than specific 
to the sciences, 


Experimental Croups 

All or most of the tests descrihed above have been adminis- 
tered to the following groups: (a) 37 first-, second-, and third- 
year graduate students in phy.sics and chemistry at Catholic 
University; (b) about 150 physicists, chemists, and engineers, 
in grades P-i through P-7 (about $2,900 to $9, boo), engaged in 
testing, instrumentation, standardization, and other research 
work at the National Bureau of Standards and the Naval Ord- 
nance Laboratory; and (c) about 125 research and develop- 
ment engineers at the Air Materiel Command laboratories at 
Wright-Patterson Fields. 

Criterion 

The criterion used at Catholic University was a rank-order 
listing by professors on over-all ability, theoretical ability, and 
experimental ability. The professors were asked to rate the 
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students on the basis of predicted performance as employees in 
a laboiatory, rather than on University performance. 

1 he criterion used at the Federal Government research 
laboratories was a yraphic-rating scale consisting of a number 
of elements to lie rated on a five-point scale, and summary 
ratings also made on a five-point scale, of general over-all 
ability, theoretical ability, and experimental ability The 
ratings, specially prepared for the purposes of the study, were 
completed by vsupervisors, colleagues, and subordinates in two 
of the researciv laboratories; in the third laboratory, the sub- 
ordinates did not rate. The ratings from all groups were com- 
bined arithmetically into one average rating for use as the 
criterion. vSalary level was used as an additional criterion. 
Preliminary analysis of the agreement among raters at one 
laboratory, where the average number of raters per subject 
was low, indicates that the extent of agreement was somewhat 
higher for Chemists tlian for Physicists but the reliability was 
too low, even for Chemists, to expect satisfactory results. 

h'ollnwing is a brief statement regarding the value of these 
tests for predicting ability in the physical sciences. It should 
be recognized that tliere were too few items in many of these 
tests U) obtain satisfactory reliability; also, the method of test 
administration was such that subjects could spend diflFerent 
amounts of time on each test since a number of tests were ad- 
ministered with one over-all time limit. 

I Abstract Reasoning . — The validity coefficients for this 
test for samples of between ai and 28 Chemists and Engineers 
are about .5®, using ratings as the criterion; the validity coeffi- 
cients for Physicists, using ratings and salary level as the cri- 
teria, are about zero. Successful discrimination for this test 
was also obtained on the Catholic University student sample. 
It is difficult to reason why these different results for Physicists 
were obtained; the standard deviation of the test for a group of 
38 Physicists was 9.04, which indicates that lack of spread in 
the scores would not account for this result. 

2. Gottschaldt figures . — Engineers were the only group for 
whom this test produced even moderately good results; using 

“All of the coefficients are product-moment. 
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ratings as the criterion, a validity coefficient of ,4 was obtained 
for a8 Electrical Engineers. 

3. Spatial 7 ‘esls.- -Surface development itcjns gave moder- 
ately good results for Physicists and Chemists although these 
results are highly tentative; for Engineers, however, the block 
formulation items had a correlation with ratings of two groups, 
a 6 Electrical Engineers and 19 Mechanical Engineers, of .4. 
None of the other spatial tests produceil gootl results with these 
groups. 

4. Mathematical Formulation. 'Phis test was one of the best 
tests among those tried out on Engineers ; the validity coefficient 
for a group of Electrical Engineers, using ratings as the 
criterion, was .59. The rc.sults with Chemists were moderately 
satisfactory; the test did not discriminate among the Physicists. 

5. Inteipretation 0/ Data.— Prom'iam^ results were obtained 
for this test with Chemists and Electrical Engineers; the results 
with other groups were imsignificant. 

6. Hypotheses.— This test was the only test whose results 
were promising with all of the three groups, Physicists, Chem- 
ists, and Engineens, included in this study; the high inter- 
corrclatlon of this test with most of the tests, which probably 
accounts for its consistent validity, also tenths to reduce its 
value since the zero order validity is not liigh enough to select 
on the basis of this one test alone. It may be possible to 
purify this test to reduce these intercorrelations witlmut too 
much loss in validity. 

7. Biographical Information Blank.- -Tlvi results obtained 
from this instrument arc very promising. The validity co- 
efficients obtained for this Blank with Chemists and Jffiysicists, 
using a pre-determined scoring key with weights of -pi, o, and 
— I, were moderately good; in addition, the low inter-correlation 
of the scores on this Blank with the other tests indicate that it 
can contribute to a multiple correlation. Based on a total of 
98 physical scientists, consisting of two groups of Physicists 
and one group of Chemists, the following types of items seemed 
most promising: outstanding work in mathematics in high 
school; graduation from college in the top 10 per cent; lack of 
participation in high school athletics; graduation at the age of 
16 from high school; and lack of interest in the administrative 
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aspects of scientific work. Items on these subjects, plus a 
number of others, were highly discriminating with the item of 
age of graduation from high school the most discriminating. 

8. Science Based on performance ratings as a 

criterion, this test gave the best results on a sample of 33 
Physicists, +.48; its results for Chemists were also moderately 
good, while the validity coefficients with Engineers were about 
zero. Since the Engineers tend to be engaged in development 
work, rather than research work, this difference can be under- 
stood. It is hoped that a more reliable test of this type would 
be useful for selection for research positions. 

9. Sul/ject MaUer—Tlm test gave the most consistent results 
among the two independent samples of Physicists consisting 
of 62, cases at the Bureau of Standards and the Naval Ordnance 
Laboratory, using salary level as the criterion The results 
in both cases were about +.5. 

The other tests in this battery, based on the obtained data, 
did not contribute significantly. These data cannot be con- 
sidered conclusive because the various factors that contribute 
to the results were not controlled sufficiently in these pilot 
studies. Studies based on these tentative results are now 
being continued so that firm data, useful for prediction of 
ability in these fields, may be obtained. The tentative re- 
sults obtained seem to indicate that selection for this im- 
portant group of positions can be improved. 




A FACTOR ANALYSIS OF SELECTED SENATE 
ROLL CALLS, 8oTH CONGRESS 

CHESTER VV. HARRIS 
UniverMty of Wisconsin 

In sr.PTKMBRR, 1947, the League of Women Voters of the 
United States published a pamphlet entitled Significant Roll 
Calls, Soth Co 7 ig}'ess, First in which they presented vot- 

ing records on selected issues. In a foreword, they point ouf 

Since it i.s not possible for us to list the full record of every mem- 
ber of Congres.s on all issues, we have selected what we consider 
to be .some of the most significant roll calls duiing the first ses- 
sion of the Hoth Congress. 'I'he selection was made on the basis 
of i.ssnes in which the League has been active, with the ex- 
ception of a few issues of general interest on which the organi- 
zation look no position.^ 

Using these data, an analysis has been made of the voting rec- 
ord of the Senate on nine issues. The procedure was to deter- 
mine tctrachoric coefficients of correlation between each pair 
of roll calls for the 95 senators. “ These correlations were 
then analyzed by means of factor analysis 
The Senate roll calls listed by the League of Women Voters 
are as follows: 

I. Taft motion to table second Overton motion to seat Bilbo. 
Pa.sscd. 

a. Tydings amendment to continue Investigation of the na- 
tional defense program under a standing committee (Ex- 
ecutive Expenditure) rather than under a special commit- 
tee, Defeated. 

3. Bricker motion to recommit nomination of Lilienthal as 
chairman of the Atomic Energy Commission. Defeated. 

4. Grcek-Turkisli aid bill. Passed. 

5. Taft-Harlley labor bill. Passed. 

1 League of Women Voters of the United States. Signifcml Roll Calls, 3 oih Con- 
gress, First Session, 726 Jnckson Place, N.W,, Washington, D, C., September, 1947. 
IPublicntion No. 98, page 2.) , . , . 

’ Senator Bilbo (MlssiMippi) did not vote. Overton’s motion to seat him was 
tabled on January 1047, Senator Bilbo left Washington without being seated, 
and later that year, died. 
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6 . Kcm amendincni tn cur fiueign relief funds from S350 
inillitm to ,$200 million. DefcatecI 

7. Income tax reduction bill. I’as>.e«l.* 

H. Ilawkes amendment to allow I5'7 increase in reiu when 
agreed to liy landlord atul tenant, Passed. 

9. Confeience report on wool bill, providing price .support 
and aiitliori/ing increase up to 50',' on imported wool. 
Pa.ssed, 

10. Resolution to disapprove the President's Reorganization 
Plan ^3, consolidating the housing functions of the gov- 
ernmeni in a single agency. Defeaied, 

Roll call number i, above, was not inckulctl in tlii.s analysis, 
since a large proportion of the Senators had not been seated— 
and consequently were not eligible ft) vote when d'aft’s mo- 
tion was introduced. The remaining nine roll calls were in- 
cluded, and in adtlition the paity designatitin (Republican or 
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Democrat) was Included as a variable, 'rhis gave ten variables 
for analysis. The symbol R is u.sx-d to designate the party 
variable. Numbers corresponding to those listed above are 
used to identify the nine roll calls. In determining the cor- 
relations, a formally-expressed opinion was regarded as equiv- 
alent to a vote. Congressional procedures provide for pairing 
for or against issues, and, in the Senate, for the announcing of a 
position for or against an issue on behalf of an absent Senator. 
Pairing and announcing thu.s give formal ex[)ression to a 
Senator’s attitude toward or judgment of an issue. 

The correlation matrix is presented in Table i. In prepar- 

’This refers to the originnl pnssnge of the Bill. Lnter it was vetoed and the veto 
sustained. 
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mg the correlations, a vote or opinion in favor of the issue 
was taken as the positive section of the dichotomy, and the 
designation of Republican was made the positive section of the 
Rcpublican-i;)cmocrat dichotomy. When this is done, vari- 
ables c and 6 have consistently negative relationships with 
each of the other variables. These two variables therefore 
were reflected to secure the matrix presented in Table i The 
interpretation of these correlations may be facilitated by list- 
ing the variables and the designation or opinion that represents 
the fositii'e section of the dichotomy. 

I, Republican. 

a. Against Tydings amendment (i.e., m favor of setting up a 
special committee to continue tlie investigation of na- 
tional defense expenditures, rather than allowing this in- 
vestigation to take place as contemplated in the Reorgani- 
zation of Congre.ss Act.) 

,3 Against the confirmation of Lilienthal 

4. Against (ji'cck-Turkisli aid bill 

5. h'or the Taft -1 lartley act 

0 I'or cutting foreign relief funds 

7. h'or income tax reduction 

h. h'or increase in rent 

9. h'or price support of wool 

10. Agaimst comsolidation of housing functions in a single 
agency, 

d'hc correlations presented in Table i suggest the presence of 
more than one common factor. In order to check this, a Spear- 
man single general factor solution was computed, and theresid- 
ual.s examined. The presence of substantial lesiduals ranging 
from — 317 to -b.480 confirmed this suggestion. An attempt 
was therefore made to extract more than one common factor 
from this matrix. 

The centroid method, as described by Thurstone,'* was used 
to extract three common factors. Since this is a relatively 
small matrix, it was necessary to repeat the factoring process 
three times in order to achieve stable communality estimates, 
h'or most of these variables, the communality estimates are 
quite high, and a few exceed i.oo slightly. This fact raises the 
question of whether or not this factoring method has failed 

‘Thurstone, L. L, Multipk-Faetor Analysis. Chicago- University of Chicago 
Press, 1947. 
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to allow adequately for variance attributable to uniqueness in 
the variable. It may be aigual that tlie opinions expressed 
on any one issue would be highly reliable in tile sense tliat the 
expression of the opinion represents a position taken after care- 
ful study. In other words, given a similar .situation, each 
Senator would be likely to vote again just as he voted before.' 
Specificity, the second postulated component of uniqueness, 
also may be absent from many of these issues, since many of 
the same determiners may enter into the formulation of opin- 
ions on two different is.sues. Since reliability estimates can- 
not be made readily for these variables, and since specificity 
cannot be calculated independently of the estimates of com- 
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mon-factor and unreliability-factor loadings, it is difficult either 
to maintain or deny that this method has resulted in a serious 
over-factoring. The three variables u, 5, and 6, whose com- 
munalities are slightly in excess of i.oo, are of course over- 
factored. This may not be serious, however, if uniqueness is 
negligible for these variables. 

The three centroids extracted and their accompanying com- 
munality estimates are presented in Table 2. The familiar 
pattern of substantial positive loadings on the first centroid and 
a bipolar structure for the second and third is apparent here. 
Since a central reference vector appears here, it is possible to 
use Thurstone’s method of extended vectors." The plot of the 

‘The second vote on the income tax reduction Biii (following President Truman’s 
veto) presents some evidence that this is true. 

Chapter XI. 
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extended vectors is given m Figure I. In this figure, the clus- 
ter foj-med by P, 2., 7, and 8 — which was obvious in the cor- 
relation inatrix'—is prominent, With these ten variables, all 
planes are not adequately determined. 

Two alternative interpretations are proposed. One would 
be to regard variables 9, 6, and 2. as each having a maximum 
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positive projection on one of the three rotated centroids. One 
plane would be defined by variables 9, 2, 7, 8, and 5. A second 
plane would be defined by P, 2, 3, and 6. The third plane is 
not located precisely. This interpretation would locate one 
of the rotated centroids in the cluster P, 2, 7, and 8. A sche- 
matic interpretation of this factor structure can be given as fol- 
lows, Plus and minus signs are used to designate the substan- 
tial loadings. 
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This Structure is oblique, with a fairly large correlation between 
I and III. 

A second interpretation consists of regarding variables 9, 6, 
and 5 as each having a maximum positive projection on one of 
the three rotated centroids, Variables 9, a, 7, 8, and 5 would, 
again, define one plane. The remaining two planes would 
not be located precisely. A schematic interpretation of this 
structure is as follows; 
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This second structure was chosen as the basis of the inter- 
pretation to be made. Orthogonal rotation of the obtained 
centroids gave the factor loadings that appear in Table 3a. 
These loadings indicate that the structure given above is ap- 
proximated quite closely by this method of rotation. Table 3b 
gives the loadings on the three centroids when these reference 
vectors are permitted to be oblique. As the matrix A'A in- 
dicates, there are small positive correlations among the three 
primary reference vectors for this solution. The similarity of 
loadings for the orthogonal and the oblique solutions is marked, 
and both solutions suggest essentially the same interpretation, 
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Rotated Factor I or A has as its highest loadings those for 
the following three variables. 

5 Attitude toward the Taft-Hartley act 
8 Attitude toward increase in rent 
7 Attitude toward reduction in income tax 
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TABLE 3b 
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MATRIX A'A 
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B 

c 

A 

1 .000 
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C 
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It is proposed, tentatively, that this factor represents an atti- 
tude toward the interests and methods of big business and man- 
agement. AsubstantialloadingforP(partydesignation)on this 
factor is not surprising. Variable 2 also has a projection of some 
size on this factor. This issue dealt with governmental or- 
ganization, This projection may be accounted for in terms of 
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the well-known opposition to what is often called “bureaucracy” 
by supporters of the point of view of big business and manage- 
ment. Opposition to Tdlienthal (variable 3) also appears to 
have stemmed in part from disapproval of the TVA, with which 
he was connected; consequently, the projection of variable 3 
on this factor is in keeping with this hypothesis. 

Rotated Factor II or B seems to be clearly an "isolationist- 
internationalist” ])oint-of-vic\v factor. Issues 4 and 6 both 
dealt with aid to foreign lands. The objections to Lilienthal, 
it will be recalled from the Congressional hearings, included 
censure of his foreign ancestry and a questioning of his “Ameri- 
canism.” 

Rotated Factor III or C, with its highest loading on variable 9, 
may be an attitude toward protection of home industries. 
It is difficult, however, to account for the projection of variable 
10 on this factor according to this hypothesis. Another hy- 
pothesis that might be advanced is that this factor represents 
a point of view toward the interests of agriculture as opposed 
to industry. It should be noted that the alternative interpre- 
tation, taking this third factor as bipolar, presents the same 
problem of naming the factor. Students of political science 
may wish to bring to bear their greater knowledge of political 
issues on this problem. 

Summary 

The analysis of opinions of members of the Senate as ex- 
pressed in their voting behavior suggests that three points of 
view underlie these nine specific opinions. Two of these points 
of view were tentatively identified as; (i) a point of view with 
respect to the interests and methods of big business and man- 
agement; (a) a point of view with respect to our relation with 
foreign countries, The tliird factor presents an interpretation 
problem. Further studies should be designed to test certain 
hypotheses regarding this third point-of-view factor. For ex- 
ample, the addition of variables representing issues that appear 
to be determined primarily by consideration of protection versus 
free trade, and of agriculture versus industrial interests, would 
permit a re-analysis of this correlation matrix that would pro- 
vide checks on these two hypotheses. Further studies of cor- 
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relation matrices based on more recent voting records also 
would be useful in exploring this domain of senatorial attitudes. 

The method used in this study represents an application of 
factorial methods, which were developed primarily in connec- 
tion with the. analysis of mental abilities, to the analysis of 
opinions. Such an application is, of course, not new. The 
usefulness of these methods, however, for the student of politi- 
cal science and the student of social psychology may be em- 
phasized by tills further application. 




SOME OBSERVATIONS ON THE COLLEGE BOARD 
LANGUAGE TESTS^ 


HENRY S. DYER 
Harvard University 

Colleges that require the knowledge of a foreign language 
for the bachelor’s degree have the common problem of placing 
new students in elementary language courses that are appro- 
priate to each student’s level of competence. The amount of 
language study that the student has pursued in secondary 
school is not ordinarily a very helpful guide. Student A with 
three years of French in one school may be as much as a year 
behind Student B who has had only two years of French in 
another school, Students C and D may both have studied 
two years of secondary school Spanish, but C resumes it in 
college after a three months lapse and D after a fifteen months 
lapse. In any case, when the amount of exposure to language 
teaching is the sole criterion for course placement, there is 
considerable likelihood that the entering student of good general 
competence may find himself in the wrong course. 

To avoid as far as possible the misplacement of entering 
freshmen. Harvard and Radcliffe Colleges regularly require all 
new students to take placement tests in French, German, and 
Spanish. When the student enters college, he or she may take 
up the study of any of these languages at any one of five differ- 
ent levels, or, on the basis of demonstrated competence, he 
may be exempt from further language study. 

The principal, though not the only, objective of the elemen- 
tary courses is to provide the student with a reading knowl- 
edge of the language in question. If he starts from scratch, he 
ordinarily can acquire this knowledge in four semesters. If he 
has had previous preparation in the language, he is required 
to take a test in it either as part of the tests for admission or as 

^The rending tests in French, German and Spanish were supplied by the College 
Entrance Examination Board. 
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pait of a series of phu'omcnt- tests administered immediately 
after registration Ar the time the data reported in (his study 
were collected, both the enframe and placement tests were 
those furnished by the College Entrance I'lsainination Hoard, 
The results of these tests were the irrimary ba.sis for placement 
in the elementary language couises 

It is the purpose of this paper t(v describe briefly how the 
results have Ircen used in course placement, and to point out 
certain features of the tests which have heconie evitlcnt from a 
study of their validity. 

As the numbering of the courses varies from one department 
to another, arbitrary designations are used in the present report 
as follows: 

A Roman numeral following liie name of the course designates 
its level in terms of semesters. Tims, b’rcneh T ilenrjtes the 
first semester of heginning French, French III denote, s the 
third semester course in Frenclr A comlnnation of numerals 
designates an intensive course. Thus, hVeneh I II denotes a 
course that covets the material of French I and French 11 in a 
single semester, 

1 . 

In order to make the te.sts maximally useful for course place- 
ment purposes, it is of first importance that the results sliall be 
available bejore the freshman meets hi.s faculty atlviser Co lay 
out his course program. Ar Harvard and Radclifle the exi- 
gencies of freshman registration reejuire tliat the rests shall be 
given on a Friday anti that the results shall be placed in the 
hands of students and advisers not later than the following 
Monday morning. The special techniejues by which this task 
is accomplished have been described elsewhere.® The jtrincipal 
goal of the entire procedure is the preparation of a “Course 
Placement Recommendation” form, a .sample of which is shown 
in Figure I. 

It will be noted from Figure I that tltc adviser receives not 
only the scores of his studenis but specific jdacement recom- 
mendations as well. Thi.s practice is followed to relieve the 
adviser of the necessity of interpreting scores whose significance 

• Dyer, Henry S. "Making Teat Score Data Kffcctivc in tlie Admission and 
Courae Placement of Harvard p'reshmen." Proeeedivp af the Research Forum. 
Endicott, N, y.; International Business Machines Corporation, 1946. pp. s 6 ~Gi. 
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may not be readily apparent. It reduces the likelihood of 
erroneous advice and misinformed decisions. However, since 
the relation between test scores and language achievement is by 
no means pci feet and since in certain cases there may beknown 
factors which would cast doubt on the validity of anindividual 
score, some latitude is given the student in deciding upon the 
particular course he is to take. 

This flexibility is accomplished by making placement recom- 
mendations of two sorts. If the score falls at a point which 
leaves little doubt about the proper placement, the recommen- 

AOVISER'S CO?Y 

HARVARD COLLEGE 
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FlO. I. Course Placement Recommendfition Form 

dation is made without any reservations. Even in such cases, 
however, the student is permitted to consult a representative of 
the appropriate department if he thinks the placement is wrong. 
On the otlier hand, if his score falls in a “borderline zone,” the 
recommendation is followed by an asterisk (see Figure I), and 
the student is not only permitted but requested to consult the 
departmental representative before making a final decision. 
These departmental representatives are fully armed with test 
data and school records to meet these situations, 

Both advisers and departmental representatives are supplied 
with tables showing the Course Placement System for each of 
the three languages. The data of these tables are summarized 
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in Table l. In fliis fable the catcgoiics labeled"! or II”, "H 
or III”, etc,, constitute the bftrderline xfmes. These /ones 
represent the areas within which it is estinnited from the test 
score that the stiulcnt would have received a D or a “weak C” 
in the lower course if he had taken it at collejtc. It will be 
noticed that the scores which ‘‘place” for any uiven semester 
differ from one language to another. These ditferenec.s arise 
from the fact that the .system for each language depends upon 
the performance of students who have actually been taking the 
courses. The necessary information is obtained hy aclminis* 
tering the tests near the end of each semester to all students who 
are actually enrolled in the courses. The score systems are, 
therefore, subject to annual revision. 

TAin.K 1 

.Vfor/ Hysleiui in list m llnnnui and liaJchJfe Cnikgts fur Viaumtnl in KUmintarj 

Ciiiiruf idef'lemhr njf/) 

». iTJ'-ff-, " L-u, /) I» , ' , ' -r I r 1, 


C<)ur4c Kecommcnilcd 




I 

U< low ,) 4 V 

Hrlow 4 ii; 

Below 140 

] or 11 . , 

.ta-’-.a*') 

4.i'> 4.1') 

.15” .i''y 

11 

■tvo 44') 

44” 4”') 

.!7') 44') 

11 orlll 

4?1> 4fM/ 


4 5” 4 I") 

IP 

470 (;’■!) 

CIO Sir, 

4'-'> Cr,() 

in or IV. , . . 


•U” 5.1') 


IV 

c.vj a-) 

54” 54') 

5,10 !t"J 

IV or beyond 

S'A< '5!*') 

cco 50 

5Tt> 5 H 0 

Beyond IV 

S‘/3 ‘ind nl«ivc 

and aUiivr 

5 v» .md alxive 


Any comparisons one might he tempted to make from Table 
I as to the relative rates of progress made by students in the 
different languages is almost certain to be invalid, .since the 
scales on which the scores arc reported arc not comparable 
from one language to another. It is possible, for example, 
that a score of 450 in French represents ‘‘more achievement” 
than a score of 500 in German. 

11 . 

The justification for using any tests for course placement 
rests on the evidence of their validity. The definition of the 
validity of a test depends upon the particular way in which it is 
to be used. If a test is intended to predict liow well students 
will do in college, its validity is defined as the correlation be- 
tween the test scores and some generally accepted measure of 



BOARD LANGUAGE TESTS 


597 

later perfoi niance such as course grades. If a test is intended 
to provide an index of the student’s level of performance at the 
time he takes the tc.st, its validity is defined as the correlation 
between the tc.st .scores and some generally accepted measure of 
performance which is applied, or might have been applied, 
at approximately^ the same time that the test itself is applied. 
It i.s the latter tlefinition which is applicable to the present case, 
for when proficiency in foreign language is ultimately required of 
all the .students in college, the problem is not one of predicting 
the student’s future accomplishment; it is a problem of de- 
scribing his present status. 

The importance of this di.stinction is clear when one considers 
llie ca.se of the new freshman w'ho is trying to decide whether he 
is leady for second-semester German or third-semester German 
If he goes into the .second-semester course, he will find it heavily 
populated with students w’ho have just completed the first- 
semester cour.se; if he goes into the third-semester course, he 
will find liimself in the company of students who have just 
moved u[i from the second-semester course, The problem is 
to tlcterminc whctlier Itis knowledge of German is more nearly 
equivalent to that of the first gioup of students or to that of 
the second. 'Die <iuc.stion to be asked of the German test, 
therefore, i.s whctlier and to what extent it can make this 
determination. 

One proiluct of the administrations of the tests in courses 
has been a considerable accumulation of information con- 
cerning the validity of the tests as defined above. Findings 
from a portitm of the data have been reported elsewhere.® 
The present paper presents more extensive information. Al- 
though the quantity of data available varies somewhat from 
test to test, there appears to be a sufficient amount to warrant a 
number of general conclusions. 

At the time these tests were given, the results were usedin 
determining the final grades of the students, but it is only fair 
to stale that scores were available to the instructors if they 
cared to satisfy their curiosity. There is, therefore, a bare 

sDyer, Henry S. "Validity of the C.E.E.B, Placement Test in French," The 
College lioard Heeim, 1(1947), i, «nd "Validity oF the College Board German 

Test,”' The College Board Rmem, I(i947), 04-16. 
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possibility that in certain instances the final p;rade of an in- 
dividual student may have been affected by the instructor’s 
kno-svlcdye of his score. In the opinion of the writer such in- 
stances were so raie as to produce no important upward bias 
in the correlations between the test scores and the final grades, 
Table a shows the correlations. The probable errors of 
estimate (P.F..r,i) have been given in the table to provide a 
basis of comparison from course to cour.se. When interpreting 
the P.E.tti, one shouhl bear in mind that the letter grades were 
converted to a twelve-point scale as follows; K o, D— ~ i, 

I) ^ a, D+ « 3, C- - 4, C - 5. e-1 - fi, B 7, B =. g, 
B-b - 9 j A- “ 10, A = n. Thus, if the equals i.o, 
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1 .1 
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■ ■ K1 
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* Harvard and Raddiffc comlnncd. 


the distribution of obtained grades about an e.sti mated grade of 
C would show a concentration of 50 per cent of such olitained 
grades within the range C— to C-f-. 

Prom an inspection of the data in Table 2, it appears that 
there is a tendency for the relationship between test scares and 
grades to become larger as the courses become advanced. In 
other word.s, the tests seem to be more valid for measuring the 
achievement of second-year students than they arc for measuring 
the achievement of first-year students. I'his result is not sur- 
prising in view of the fact that the tests were originally designed 
for use primarily with students who have completed at least 
two years of language study in secondary school. If the tests 
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arc to be generally used for the course placement of college 
students, it would be helpful to have them strengthened at the 
lower end of the scale. It is a question, however, whether such 
an improvement would be possible in a one-hour test without 
making sacrifices at other points. A test which provides a 
sufficiently high ceiling for fourth-semester students must 
necessarily ctmtain material which is “dead wood” for the 
first-semester .students. Similarly, a fully adequate sampling of 
the relatively simple material suitable for first-semester stu- 
dents would crowd the test with items incapable of discriminat- 
ing among more advanced students. Since the placement 
problem i.s usually most crucial at the higher levels, the C E.E.B. 
tc.sts seem to effect a reasonable compromise. 

In general, the cjrcler of magnitude of the correlations is about 
as high a.s one could expect in the circumstances. It may be 
worth emphasizing chat in each case the test score represents a 
a otie-hotir .sampling of the student’s ability solely to read and 
under.stand the language in question. The test provides no 
opportunity for the student to exhibit his knowledge of “formal 
grammar," his skill in written translation, the facility with 
which he cun speak or write the language, or his ability to 
understand the s|ioken language. Yet the course grades with 
which the tost .scores have been correlated reflect, in varying 
degrees, the student’s competence not only in reading, but in 
thc.se other functions as well. In any case, the tests appear 
sufficiently valid to warrant their judicious use as aids in course 
placement. 

Two further observations may be made; (i) In five instances 
out of seven the tests seem to be slightly more valid for the 
Radclifi'e v'omcn than for the Harvard men. (2) A rough 
compari.son of the probable errors ofestimate found on each test 
suggests that the three tests are approximately equal in validity 

HI. 

Tire College Entrance Board tests under discussion are known 
officially as “The French Reading Test,” "The German Read- 
ing Test,’’ and “The Spanish Reading Test.” The term “read- 
ing” in each of the titles raises the question of just what the 
authors intend. It scarcely needs to be said that reading in 
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any languaue is a c4iiri|Htsitc functinn, A lesf of 'Vcadini'” 
defines ihc lunfiinns in fcrim uf tlie cfimprnicnfs if- samples, 
and these iTini[xinents fheni.sclvt-s may he tietineii in teinr; nf 
the item types used The item types f'r.und in the CJvK II, 
J.anguutie Tests are hdly desfrihed in nne nf the Hoard’s rcgtilar 
publicatioiisd As dclined hy flic test items, the components 
are roiiplily as follows: 

Compriiicnt A. Ueensiniiinn nl ilie enius t I" e<|uiv:»lenr 
of u hiri’isn wurit. 

Ctimpoiiciit H. Rcesigniiion uf the ei<ricet foreign equivalent 
of an Knglish wnni. 

Cumpunenr C. Reciignitinn of ‘.ynonvnis among several for- 
eign wsinls. 

Cumpoiiciit D. Rccfignition itf corieet foreign language usage 
in Cfintext. 

Coniponeiit T'.. Recognition of Maiemenis in the fireicn lan- 
guage which correctly interpret the sense of 
prose pass.tges in the language. 

Cumponent F. Recognition of Fngli^li words oi phiascs as 
tile most exact translatioits of foreign ssonli 
ur |>hr;ncs gi\en in context. 

None of the tests usetl in the present study appears to measure 
all six componeitts, anti there is some variability in the ex- 
tensiveness of tlic sampling of each. 'Table j .summarizes the 
situation in this respect. 

A rough indication of the imixirtance attached to each ettm- 
ponent in certain of the elementary language course.s at Har- 
vard is given by the corrclafitins of the part .s-cores tm the tests 
with the final grades, Talile 4 .s!iow,s these correlation.s. 

Since the individual parts of tite test were not separately 
timed, one cannot be certain that the relatively low correlations 
for Compnent E (notably in French II and German 11) arc not 
the result of the fact that sonic .students did nor allow suiBcient 
time to do themselves justice on this part of the test. Fur- 
thermore, the value of any comiHinent on one tc.st is not directly 
comparable to the value of the same comixmcnt on either of 
the other two tests because of tliffercnces in the iiumlicr of items 
used. 

It ivS nevertheles.s interesting to note that for tlic tests in all 
courses Component D (recognition of correct foreign language 

‘ College Entrance Examination Buani. Bulltiiii tj Irifermatioti, UMfi-1947, 14-17* 
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usage in coiirext) ranks at or near the top in importance. On 
the other haml, Component E, (in the case of Spanish, E-F) 
wliich comes the closest to duplicating what might be thought of 
as a "total reading situation” occupies, with one minor ex- 
ception, the lowest rank in importance. One hesitates to 
place too much weight on this finding because of the possibility 
referied tti above that variation in the students’ rate of work 
may be rendering these cm relations spuriously low. It would 
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X„wht rf Items ,ii the CKF.lt Ijinniiaxe Tests Which Sample Various Components 
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* foiiil’tincnfi. K anil K are inilndeil in the same part score of the Spanish test. 


be worth experimenting with a rearrangement of the tests to 
investigate this po.ssibility. 

Another feature of Table 4 may be remarked upon In the 
case of German, the component scores show the same rank order 
of intporranct* for both second- and fourth-semester courses 
In the case of French and Spanish, however, there is some 
variation in the pattern. For French IV, for instance, Com- 
ponent A (recognition of the correct English equivalent of a 
foreign word) is at the top with an r of .58, but for French II it 
is next to the bottom with an r of .37. In Spanish IV^ Corn- 
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pcmcnl: B (recognition of* the correct foreign equivalent of an 
Knglish word) is at the top with an rof .76 anti for Spanish II it 
is at the hottoni with an r of .49. Both of these tlifl'ercncos are 
statistically significant.^ They probably reflect some diflerencc 
in emphasis at the two levels of instruction. 

The word "inqKirtance" has been used here rather freely, 
The question "importance for what?" is a legitimate one. We 
should not be led into the false reasoning that (he components 
have been defined as elements in the reading prtuess and that 
their relative importance therefore refer, s to the degree to which 
they take part in that process, Ail we may infer is that in- 
structors may weigh certain of the components more heavily 
than others in their judgment of the worth of a student's per- 
formance in the language being taught. The validity of the 
component (i.c., its imptirtaiice) is here regarded solely as the 
degree to which mastery of the skill involved is rewarded by a 
good grade in the course. A study of the present .sort shows 
how well or ill the test makei has forecast the instructor sjiulg” 
ment A low correlation may he the re, suit of fault in the 
test maker’s craftsmanship or it may represent a hasu: differ'- 
ence between what the test maker and the instructor judge to 
be important. In the latter case, one need hold no brief for 
either party, but hope that the tangible evidence of di.sagree- 
ment will clarify the thinking of both. 

‘ In each cntc the (lilFercntt in ther's is alniw (lit ^ |*Fr tent level of confidence. 



THE GROUP ORIGINS OF STUDENT LEADERSi 

K G. WILLIAMSON 
tJnivcrsity of Minnesota 

Ckitics of the college fraternity system often charge that 
members arc elected or appointed to college-wide leadership 
offices in numbers that are disproportionate to the relative size 
of total fraternity membership. In substantiation of such 
allegations, Mueller and Mueller found that sorority members 
(largely from homes classified in the higher socio-economic 
groups) were greatly over-represented in both general extra- 
curricular activities and in the category of social honors.® 

The present study was undertaken in an effort to discover the 
extent to which fraternity and sorority members dominate the 
“most important" campus positions in student organizations 
and activities in the University of Minnesota. Data were 
gathered for three separate years, 1941, 1944, and 1947, to 
give comparisons between a pre-war, a mid-war, and a post- 
W!ir year. 'Die Minnesota study differs from the Muellers’ 
investigation in its restriction to the “most important” 
activity po.sitions and also with respect to its inclusion of 
fraternity as well as sorority members in comparison with non- 
member students. 

In such an investigation of the monopolizing of leadership by 
any particular group or type of students, a most important 
procedure inv'olves the careful and meaningful classification of 
positions of leadership in terms of type and importance. The 
list of important campus activities to be studied was chosen to 
reflect the general student evaluation of the importance of 
leadership positions. The classification system used in our 
study was constructed by common agreement among six staff 

Ueiin Damilier and Donald Iloyr gave significant assistance in the statistical 
annlyie*, and : ‘ 

’ Mueller, . ' ' vatc Hevner. ''Socio-Economic Background 

and Caintnis . ' ' ■ ■ ■ and Psyoholoqical Measurement, III 

(1943). 143-'S0- 
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inetnlicrs (if the SMuini! \i'tii.iric‘. Bureriu, a I'invcisiry cifficc 
desigiK'd c.spwisilly tn pridtinte and iud sU'tivity unnip,*.. fivusuidi- 
tiniisd pn>f'c‘>*'ioiKd puni'k* wurkint' wifli studriit i»!'«tups, two 
iaciilry nn'iiilwrs inhtriuod nn r.iii)[nis su'tivirirs. and cii^ht 
■studciit.s with extensive kimwlcds.'c and experienec in many 
ditFerent campus proups. With the exee['fi(m of the suh-cate- 
pory of “tiiiecns” (not shown in tmr tallies), only tho.sc po.si- 
cions, open ttjually hy repidalion to both Fiaternity and .sorority 
mcmhcr.s ami to nonmiemhers. were inciutled, A futther re- 
finement of our elassificatinn system was mtuie by .selecting a 
group of ‘"I'op Campus- Ikisitions," consisting of four .sub-groups 
composed, in general, tif the most imj'ortant positions of the 
first i.livi.sion. Definitions of the “Important Campus Po.si- 
tions" and the “Top Cainpu.s Ihi.sitions” arc given iteltnv, to- 
gether with the number of {Ki.sifions available ill 1941, 1944, and 
1947, respectively. 

iMroiei'ANr Cami'o I'oviuoss 

vm mj 


U4 IHS 


Stj 107 


100 154 


37 421 


38 37 


154 aoo 


f'ii 

I. (iovernintt Ho.irds and (.‘ouncils; All 
imanbcrs of couiuils rcsjinnsible to a 
incmber.sliip of over i'-v snulc'iits esclu- 
.sivc of any one c!av. or college, such as 
tile Y.W.t ..4., etc. . iKj 

а. Religious ami Service ( )rt'aiu/.iri«ins: 

Pre-sitleiirs and lc.utersof '-iiulcnt chnrch 
and service grouiis, sucli as the I.ufher.in 
Students Assoeiatinn, ere. 90 

3. Special Inietesr Org-ufi/ed Choup.; 

Presidents and le.uiers of the most ac- 
tive special interest groujK, such as liie 
Kepuhlican Club, etc. . ... 129 

4. All-Lnivetsity Klecrcd Positions; The 

entire membership of groups elected by 
campuswide voting, such as the .^11- 
University .Student Council 40 

5. Student Puhlicaiions; 'Phe leading mem- 

hens of the editorial ami Inisiness staffs 
of the seven puhlications, such as the 
Z. 3 fli/y (ciunpusncw.spitpcr).. , 34 

б. Activity ilononirics: '.All memhm of 

organizations lutnoring studenra for ex- 
tra-curricular activies, such as, Mortar 
Board. lyi 
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lop Campus Positions 


1, Chairmen;— All appointments to major 

cliairmansliips for important campus- 
wide posuitjns, such as, Homecoming 
Chairman 

2. Major Campus Posts;— -Presidents of 


Total Number of Leadcraliip 
Positions 


1941 


1944 


1947 


42 45 58 


groups _i, 4, and 6; editors of Group 5; 

and major chairmen 60 cg 68 

3, Most Important Positions; Presidents of 

Groups I and 4 and editors of tlie three 

main publications 14 ir 

4. Heads of all Organizations;— Presidents 

of university recognized activities or 
organizations 174 140 180 


Fraternal groups are classified by the University as academic 
or professional. 'Phe first includes all fraternities and sororities 
who hokl membership open to students, regardless of the field or 
college in which they are studying. The second type limits 
membership to students studying in certain specified fields. 
Aside from thi.s, the groups are essentially alike, both in pur- 
pose and in function. But the two groups were treated sepa- 
rately in thi.s .study for purpo.ses of comparison. Fraternities 
and sciroritie.s were da.s.sified jointly as either academic or 
professional fraternal groups. Combining them thusly is 
stati.srically justified wlicn jiercentagcs of enrollment and of 
participation are compared for the three years, no difference 
being significant at the .01 level of probability. 

Table i below .shows the distribution of fraternal membership, 
by per cent, in each of the important campus activities and in 
the total .student enrollment for the three years considered® 
The most obvious generalization is that Table i (and Table 2) 
reveal a marked over-representation on the part of fraternal 
groups in these activities. A separate study of sorority mem- 
bers, not shown in this paper, reveals a degree of concentra- 
tion similar to that found by the Muellers. 

When the total number of available leadership positions is 
divided into the total number held by academic fraternal, pro- 


’ToibI enrollment for the three years in question was 13,603, 7 , 13 °; and 
rc.st>ective!y. All data were taken from official University records for the Winter 
Quarters of 1941, 1944, and 1947. 
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fessional fraternal, ami nrm-frafcrnal nit-mhers, fhc total per 
cent of rcpicsentatinn is ahtained. (See ligures at the bottom 
of each column in 'I’alile i.) When these jHtrcentaacs arc com- 
paieil with the pcrccntaue t)f the Dual student einollmcnt for 
each of the s»rovips, (sec the Hrst. top row ot 'rahle 0, critical 
ratios siiinificant at a level of prohahility far beyond .01 were 
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17 (> 

416 

.57 

184 

a-« 

(7 


S «1 

■E) 

Most ImjKirtant Poets , 

«4 

411 

5 *t 

117 

HA 

I't 

.E'(> 

755 

11 

Heads of all orgamraiions 

. 171 

S7I 

1<> 

241 

I >/1 

4t 

4IH 

504 

1'' 

Totals ..... . . 

a.) 8 

2 S 1 

.17 

aai 

li/> 

4'! 

4311 

470 

43 


obtained in every case. Thus the possibility (hat these are 
variatioms due to cliancc i.s statistically eliminated. Wc .see in 
Table i that fraternity student constituttal 17.0 per cent of the 
total student enrollment in 1941 but thc.se same .students held 
a total of 35.3 per cent of the nio.st importsxnc leadership posi- 
tions. Professional fraternity members constituted 10,4 per 
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cent of the enrollment and held 28.7 per cent of the positions. 
Conversely, nnn-fraternal students made up 72,6 per cent of 
the enrollment but held only 36 per cent of leadership positions, 
One of the most striking features of Table i is the showing 
made by fraternal groups in 1947. As the table indicates, the 
academic organizations composed but 9.1 per cent of the total 
student enrollment and the professional groups but 5,3 per 
cent. Yet these two groups held nearly as high a percentage 
of ijuportant positions in 1947 as in the other two years when 
their membership made up a much larger proportion of the 
student body. In fact, when the total representation by per 
cent is placed on an index number basis, as in Table 2, with 100 
leprcsenting proportionate representation according to the 
composition of the entire student population, the following 
figures arc obtained for the three years in chronological order: 
Academic fraternal groups — 208, 217, 371; Professional fra- • 
ternal groups- -276, 205, 489; Non-iraternal groups — 50, 49, 
47, I'hat is, fraternal students hold a number of leadership 
positions greater than their combined proportionate size of the 
student boily, I'his fact may hold important implications 
for the new student, especially during such periods as were ex- 
perienced after the war, when the student enrollment expanded 
rapidly while fraternal groups admitted only a few new mem- 
bers. It would seem that the new student would have not 
only a small chance of attaining fraternal affiliation, but also an 
even smaller chance of gaining an important campus position. 
An analysis of the representation (Tables i and 2) in each of 
the groups of important positions yields other points of in- 
terest. It is not the purpose of this paper to offer explanations 
for the figures presented or the trends cited, but rather to note 
their existence and to suggest a few of the possible implica- 
tions. Representation in the religious and service and special 
interest groups (see Table i) is quite evenly distributed between 
fraternal and non-fraternal members, though a degree of over- 
representation on the part of both academic and professional 
fraternal organizations is apparent for each of the years. When 
the index scheme is applied here (see Table 2), the religious 
and service groups show academic fraternities and sororities 
with index numbers of 137, 131, and 236 for 1941, 1944, and 
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1947 rcsj^er lively. Prfjftssional ^'roups have representation 
indices of 157, 158, and ,117; while the nnn-i'ratcrnal members 
arc reprc.sentcd with indice.s ol <iy. and 72. Very .similar 
figures result when .special interest representation is placed 
on tlic index system. 'I'heso are the highest representation 
figures attained liy the nniviVaternal groups, eniphasiriiig the 
universal concentration ot fraternities and .sororities. 

The large.st representation of academic fraternal organiza- 
tions occur.s in the CJovcrnina Br»ards and Councils. All Uni- 
versity Klcctc<l, and Activity Ilonoraries. Prttfessional groups 
find their greate.st ctmceniration in Puhhcaiions, though they 
are also markedly dominant in the three categories given for 
the academic organizations. Their added pie.stige in the 
Puhlicatioii group is ex[dained hy the classification of Sigma 
Delta Chi, the profe.ssional jounrahsm fraternity, niemiiens of 
. which held over :o I'er cent of ail imi'<irtanr puldieatinn posi- 
tions for each of the tiuee years. 

Index numlicr.s on participation tif academic organizations 
increase in .size e.tch year in the classifications of Cioverning 
Boartls and Councils, .Special Interest, All University Ulceted, 
and in total representation. ’Phe indices of non- fraternal 
group, s for the .same categories .show a decrease each year, 
while the professional organizations, in every case, olstaincd 
their highest representation in 1947 and their losvest in 1944. 

Insofar as the figures tibtaineil for the first, middle, and last 
year can he eonsitlered representative of a span of .su\'en years, 
it would seem tltat the degree or extent of concentration of 
fraternal group.s in lcader.ship po.sitions is increasing, and that 
of non-fraternal groups is decreasing. As was pointed out 
earlier, however, this may he a function of the size of the total 
enrollment. What is needed is a study of many more years 
with varying University populations to verify or disprove the 
trends indicated. 

Table 3 is a presentation of the same type of data as was 
given in Table i, except that the more select groups the Top 
Campus Positions are considered. An examination of the 
percentages given in the Total column indicate.s even heavier 
concentration of fraternity and sorority members in these 
positions, 
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By again rusorring to the index scheme, (see bottom section 
of 'lalde 2 ) several iiueresting facts are uncovered. In 1941, 
academic fraternal groups obtained an index number of 84 in 
the Most Important Posts classification. Also in 1941, pro- 
fessional organi/ations were under-represented in the Chairmen 
category, a.s indicated by an index number of 91 These two 
instances are the only ones in this study in which fraternal 
groups were .shown to be under participating, proportionate to 
their sixe of member.shii>. In both of these paiticular cases, 
there was a large over-representation of the other fraternal 
groups, so that the non-fraternal members attained index 
number.s of only 59 and 51 for Most Important Posts and Chair- 
men respectively for that year, 1941. 


TABLE 3 

Ihstiibiition aj Mtmhcnhtp, by Per Cent, in Top Campus Positions and in the Total 
KnrnHnientfor 11)41, 1^44, and rQ47 
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IT 
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Ft. 
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17.0 

10,4 

72.6 

18 4 

13.0 

68 6 

9.1 

5-3 

85 6 

Chairmen . . . 

?a .4 

') t 

.18.1 

40.0 

22 2 

37 8 

34 5 

8.6 

56,9 

Major Ft) 

■ 0 

4 .L .1 

26 7 

3 . 1-9 

2 y. I 

39 0 

35-3 

30.9 

33-8 

ImiHirt.irit 






26 7 

IVnk. . .. . 

I 4 ■^ 

42.8 

42.0 

40.0 

33-3 

33-3 

40.0 

26,7 

Ilcuds (if All Orgns , 

•pi 0 

2«,1 

25,8 

44-3 

25.0 

20.7 

42 2 

26,7 

3 I.I 

Totals 

42.1 


28.6 

40.9 

35.5 

33 -<5 

39 0 

24,9 

36 1 


Certain trends are again made apparent by means of the 
index method. Over the period studied, academic fraternal 
membens gained increasingly larger indices in Major Campus 
Posts and in Most Important Posts, while non-fraternal mem- 
bers showed a steady increase in participation in chairmanships 
and a decrease in Most Important Posts. Professional groups 
followed the same pattern as that indicated in Table i, except 
that they were mo.st frequently represented in the Chairmen 
category in 1944 and least frequently represented in that cate- 
gory in 1941. 

It is of particular interest to note that again both types of 
fraternal groups were most highly represented in 1947 and had 
their least representation in 1944 — the year that non-fraternal 
members made their best showing. Again the size of enroll- 
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mcnt may be invoh eii as a causal Jactnr in ways not readily 
apparent 

The effect of the war is well illustrated when u coniparison 
is made between the percentai'es «»l fraternal nrcmbeis holding 
important campus positions in the three separate years. For 
thi.s consideration, (be eririeal ratios between the percentage 
of memhership participating in the iinfsiriant activities in 1941 
were ciunpared with (he corresponding percentage in each of 
the other year.s; the figures of 1944 were alst) compared with 
those of 1947. 

Critical ratios of over 5.0 (not shown in thi.s paper) were 
obtainctl in the consideration of acatlemie fraternal groups when 
1944 was compared separately with 194I and 1947. These 
ratio.s were approximately ixi when professional groups w'erc 
considered, and were again over 5.0 when the twti fraternal 
groups were comliincsl. However, when percentage differences 
between 1941 and 1947 were considered, ami critical ratios 
computed, the liighest ratio obtained was .51. Tlui.s, the 
.similarity between fraternal partii ipation by per cent of niem- 
Itership for 194I and 1947 i.s statislically established, while 
true differences are fouml in e\'eiy instance of coinparistin with 
1944 of each of the other two years. 

Without additional tiata (brother year.s, it is not possible to 
establish I941 ami 1947 as representative year.s with re.speet to 
activity participation. Nor is it possible to estahli.sh that the 
year 1944 is .significant for its umicr ctmeentration tif fraternal 
membci.s in leadership jKisition.s. Whatever tlie causal fac- 
tors involved, fraternal participation in inifwrtanc activities 
wa.s strikingly similar during a pre-war and a post-war year, 
and was strikingly dLssimilar between these year.s and a mid- 
war year. 

But the preceding discussion of concentration of leadership 
among fraternal group.s doe.s not tell (he entire story. On tlie 
assumption that a selected few fraternal groups may dominate 
leadcr.ship activitic.s to a considerahlc extent, in other words 
that tlicre w'ill lie concentration witliin concentration, an analy- 
sis was made of the number of imjairtant position.s each in- 
dividual fraternal organixation held. The rc.sults indicate that 
in 1941 ten academic fraternities and sororities iiaving 27,6 
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per cent of ("he total academic fraternal enrollment, held 58.9 
per cent of the important positions filled by academic fraternal 
students, In I944i nine of these ten groups (one group having 
become inactive) having 344 per cent of the total academic 
fiatetnal cnrollnient, held 62.2 per cent of the important posi- 
tions fillcil by academic fraternal members. In 1947 these 
same nine groups representing only 194 per cent of the aca- 
demic fraternal memhership, held 48.9 per cent of the positions 
filled by academic fraternal members. 

The corresponding figures for the professional groups are 
even more significant. Four individual groups weie considered 
in each of tlie iliree years, with the following percentages (com- 
bined for rlie four group.s) of professional fraternal enrollment 
and leaderslrip positions held. In 1941 four professional 
groups with 1S.7 per cent of the total professional fiaternal 
membcKship, held 7^.1 per cent of the positions of leadership, 
Hy 1944 members ot these same four groups with 13.3 per cent 
of the member.ship occupied only 62.7 per cent of the leadership 
positions. In 1947 the corresponding percentages had de- 
creased to It. 9 and 50.7, respectively, Future studies will 
determine whether this downwaid trend will continue, 

The fact of concentration of fraternal students in positions 
of activity leadership .seem.s to he well established. But the 
inethodH used to achieve such concentration, as well as the 
educational and .social significance and implications are not 
readily miparent. More exhaustive investigations are needed 
to determine the .significance of several possible factors. In the 
first place, speaking from the viewpoint of an objective but not 
unfriendly researcher, these data might prove to be evidence of 
the validity of tlic contention of fraternal leaders that: (i) 
fraternities and sororities select freshmen who are “potential 
leaders"; and (i) fraternities “train" leaders. But the data 
could also equally prove to he support for those unfriendly 
critics who contend that; (i) fraternities use student political 
parties anti tcclmitjues to "get" their members elected and 
appointed to positions tif katlership; and (2.) fraternities make 
memliers of tluise non-member students who have achieved 
positions of katlership a//er they have so achieved. 

The determination of which of these four, or other, possible 
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iiiterprctaiioii.s nfnur f'lu'fs ttf lonu'nirafinn nj frafcnial mcm- 
hcrs in iinpnrranr ct} Icavk'S^hip. i*; a maitcr of 

considcralilf imporranrc fn one ulin has an iiucivsi in ii'^ing 
scientific meflintls u» i<lcnrify an*! stiuh' ilic pj'oci'v>.es used by 
student group niembeis to v-ki t ituiikTS d’he^r interpreta- 
tions als(»liave serious iinport.nu’c ffiriuR who scan bus for valid 
Ways in which to ulenfity p«*!cntiai ItMiicis luul to insure their 
tdcction, by student umups. to I'Mdcrsinp I'CHpoiisibilities If 
fraternities arul sororiiics hau* perfcin-d Muially desiialde and 
effective tnetlioils of nietuifyinu, trainim*. ami electituudlVctive 
leaders, then group workers I>y all means should learn from such 
accumulated expericnecH. It is for these reasons that we under- 
took this study of the origin of activity le.uiersbip, ’I'he pos- 
sible application of technitpies perfcctcil in fraternal groups to 
non-fraternal members dtK’s not in any way imply a necessary 
criticism of fraternities. Mtireover. such a luoadcr application 
will not necessarily weaken the frateinity system, utiless the 
technique.s so identified and used woubi prtwe to be anti social 
in their fundamental churacier. Hut if the tccliniques are 
sound and educational ami socially «lessr.ible, then their use 
will add to tlie strength of the fraternal system and, indeed, 
may well adtl tti the mcndiership and number of fraternal 
groups. 

The author's interest is base<l ujum a search for elfertive 
means of aiding more atul more stmlcnts, be they fraternal or 
non-fraternal, to gain through eolle«e activities those enriching 
personal experiences which are affordetl by studenr activities, 
within the potentialities of the individual student. More 
effective utilization of activities, hy students and personnel 
workers is the purjHxse of this first jirdiminary exploration of 
the origins, techniques and instrumentalities involved in the 
development of effective student leader.ship. 



THE DKPKNHKNCK OF FACTORIAL COMPOSITION 
OF AlHTTUDE TBISTS UPON POPULATION DIF- 
FKKKNCES AMONG PILOT TRAINEES I THE ISO- 
LATION OF FACTORS* 

FRANK J. DUDEK 
Northwcitcrn University 

Introduction 

Thi; purpose of this study was to determine the compar- 
ability of factors resulting from a centroid analysis of a battery 
of tests administered to groups of pilot trainees representing 
different selective conditions. Various theories have been 
proposed t(j account for the relationships among psychological 
tc.sts. One of tlie most promising has been that of weighted 
group factors in linear combination. In essence all methods 
of factor analysis attempt to determine the number of factors 
which mu.st be postulated to account for the relationships ob- 
served among tests, and to determine the loading or weight of 
each test in each fiictor. Thurstone’s centroid method (i8), 
for cKamplc, provides a technique for extracting independent 
reference axes. If a group-factor theory is accepted as a con- 
venient working hypothesis it becomes important next to 
examine the common factors isolated and to determine their 
natures and relationships. 

Numerous studies have been made of the common factors 
to be found in various batteries of tests (2, 3, 5, 9, 15, 20, 23, 
24, 25, 26). At the same time there has been considerable 
interest in the various conditions that influence factor patterns. 
Guilford (ri) found that factors resulting from an analysis of 
the ten suhtests of Seashore’s pitch discrimination test were 
related to the difficulty of the items. Several investigators 

*This nnkle is ba-sed on a dissertation submitted in partial fulfillment of the 
rcqiiiremcnta of the degree of Doctor of Philosophy at the University of Southern 
Californift. The writer wishes to express his sincere appredattoti to Dt, J. P Guilford 
for valuable nssistance while the study was in progress. 
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have shown tliat age niay have .Sftnie influence on factor pat- 
terns (i. 4, H. I4. 15, i2) 

Most pertinent to the present .sttuiy are the et 1 *erts of selection 
of samples upon factor patterns. This prohlem, however, has 
not been studied from an empirical standpoint. Analytical 
studies (if), 17) have iiulicaterl what mittht he expected when 
selection occurs. Thur.stone < ;i ) .studied the prohlem hy using 
measures of boxes as variables and imposing various eondition.s 
of .selection on hi.s .samplc.s. He showed that the physical 
interpretation of primal y factors remained the .same under 
wide variation.s in .selection of both .subjects and test.s, and that 
simple structure was invariant umlcr widely different selective 
conditions. The present study may he consiilered, then, as an 
attempt to test empirically the hyi>orhesis that .similar pri- 
mary factors' will he obtained I’rom a battery of tests admin- 
istered to different sainjilcs representing different seleefive con- 
ditions. 


'I’csis 

The test battery analyzed was rlie Xmrtn/jtr /p,/y 

Chissificdtiou Baltery. 'I’he tests arc briefly dvscribeil below 
(for complete licscriptions see (niilforil, 1 2). 'rhe tc.st.s are 
numbered as they appear in suhsccpient intercorrehuion and 
factor matrices. 

I. Bioffapfitcat Daia lUauk AVK<,!;f//w 'I'liis 

blank recjucstcd data rcitarclinit the pcrMtnal history of the 
subject. It con.sistcil of 6^ items abmir personal history, 
academic achievement, activities and holtbies, and work experi- 
ence. Items keyed were determined hy ucm-analyse.s which 
utilized succes.s in navigator training as a criterion. 

a. Bioguiphtcal Data Blank Pilnt (CKfmn). Tltis lilank 
was the same as the first blank dcscribetl. Items keyed to 
obtain dii.s .score, however, were based on item-analysis data 
which utilized .success in pilot training as a criterion. 

3. Spatial (h’iniiatian / fCPjojH). 'riiis test was com- 
po.sed of 4K hems that rciuured the individual to mutch .small 
aerial photographs with tne corresponding ptjrrion of a large 
photograph. 

4, Bpatia! Orientaiion II (CPcojB). Thi.s test was etnn- 
pri-sed of 4H item.s that required the subject to march tm aerial 
photograph with the area on a map which ctn-respondeil to the 
photograph, 
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C Comprehensio7, (CI614H). This test contained 

.ih ircms regarding seven paragraphs of j ending material The 
Items aliMvir each paragraph followed it directly in the boolclet 
and these were answered before the next paragraph was read 

/i. Dial and Table Rcmliup^ Test (CP6aa-6aiA). In the first 
part of this test the subject tvas recpiircd to lead indications on 
tliais which were calibrated in different units This part con- 
sisted ol bo items. The second pait, consisting of 86 items 
required that the individual find values within a large table of 
figures. 

-7. Mir/iaiika! Prindples (CIgo3B). This was a test of 40 
Items pel taining m mcclianical principles and devices 

H fiislritmriH Comprehension I (Clfii^B), The task in this 
test was to inierpiel five dial readings on an instrument panel 
and reciiiisiruct the attitude of a plane they supposedly repre- 
sented, and then choose, from a series of five possible responses, 
the verbal description that properly described the plane. The 
test cniisisted tif 15 items. 

(j. Instf Kinent Comprehension II (CI616B) In this test 
two indicators represented the flight attitude of a plane The 
t.isk was to find the picture of a plane which was in the proper 
flight attitude as indicated by the two instiuments. Sixty 
items ctiinprised the test. 

10. (rcnera! luformation Test (CE505E). This test con- 
•sisted of Ifxj items measuring general infoiination about planes 
and Hying. Also included were items requiring mechanical 
information and some pertaining to athletics. 

It. Meilliematirs rJ (CI702I''). This test was composed of 
35 ilems primarily in the foiin of equations employing algebiaic 
symlnds. 

12. Afalheniattcs B fCIaofiC). This test consisted of 30 
items of the “story problem*’ type. 

The te.sts dcscrihctl above were paper-and-pencil tests and 
might be designated “group’’ tests. They were administered 
to large groups of individuals by a trained examiner assisted 
by trained proctors. Items were multiple-choice and answers 
were made on answer sheets which were machine scored. All 
tests were timed. Tests described below, which comprised the 
remainder of the battery, were designated “psychomotor tests.” 
'I'hese were administered to small grotips of subjects (about 6 
per group) by a trained examiner. Each test required perform- 
ance on apparatus. I’hc paper-and-pcncil tests were given dur- 
ing one day of testing and the psychomotor tests were given on 
the next testing day. 

13. notary Pursuit Test (CP410B) This test requh-ed the 
subject to follow a revolving target with a stylus. The ap- 
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piiratus r<%emUh'<l a phmi'tjiraph tijiivt.ihlc near the nnrer 
alge t)t wliich w.isrnilHAhk'il .1 viu.i!! diM', The furn-Lahle 
rcv<ilv*t'(l at a cuji'.taiit ratcf>lf HPM aud rhe fa>.k wa** tn keep 
a mer.i! stylus in tmuacf with riie ill--* .ts it rravrlle*! .innind. 
Contact [letwrcti the stylus ajid daa aenvared a clock and tlie 
store was rhe Icnitth of tune in a Kiven period that contat f was 
made. The task was made complex !i> requiring the suhjert 
tokceponcol two hutfons depre*' cd with liis Ici! iiantl. lime 
of sf) hisaui-tiisc was counted only when the torrei t Initton was 
depressed, 

14. Tii'o-hitnJ (.‘r<r,r,i}>it}lh,ti IV'} iIA). Tilt, (esi re* 

cpiirrd 1l1.1t huth hands he used simsd! ancoudv in fiper.itintt 
tw’ji latiir typc handle . to follow a tatftft moving in an irregular 
path. The target was a dise in a jccolving turn t.dde, luit 
various grooves an<l cams eaiiseil the thse to move in an ir- 
regular |»ath rather than in a circle as in the A’s/at v f’msttit 
Test. 1 he .stylus, which vv.is to In* kept in ivnitart wish the 
target, could Ive moved liy .ippiopriate m.mipul.irion ol the two 
lathe-type handles. One handle moved sr forw.ird or h.ick- 
ward, and the other moved it to the nulit or left. The h.tridles, 
also, were operated in planes thar vverc at right angles to one 
another, .Seoriim was m terms of time that the stylus was in 
ctnitacr witli the target, 

ij. Complex C*if,rJhialiri» VV.ir (CM701 At. In this test the 
subject .sat fating a panel which cxnf.imed paired rows and 
columns of lights. A p.iitern oflighis .sppe.ued on rhe fianel 
iiiul the task was to reproduce tins pattern by .ippiopriate 
niovcmeiits of a “.stick" and nidder-lur. When the iiattern 
of lights was suecessf'ully reproduced, it would cliange auio- 
ttuideally and a new* movement w.is called for on the juirt of 
the sulijcct. .Scoring was in rcrnis id' the number of correct 
reproductions accomplished in a given periml of time. 

if). Hifi/i/er Cofifrol Test {CMiinBV In tliis test the subject 
.sat in a mock cockpit th.tr w.ts rather tinstahlc. He sighted 
over the cocknir at a target a small tiisiance away. The ta.sk 
was to control foot pressures cm rudder-bars so as to keep the 
cockpit in line* with the target. .Any change in pressure of the 
two feet, once the cockpit was in line with the target, would 
cause the cockpit to turn away from the target in the direclion 
of greater pressure. Scoring was done with automatic timers 
which registered the amount of time in a given period that the 
cockpit wa.s in proper alignment with rhe target, 

17. Diseriminotmt Hettffwii Time Test (CPfuiDK In this 
test the suhjcct sat facing a v'criical panel on which it was pos- 
sible to flash red and green lights in different relations to one 
another, In front of the .subject was a Imrizonral pane! of 
switches. Which switch the subicct was to push dc[>cnded on 
the relative pcMiriim of the red to the green light, Scoring was 
in terms of total time to make correct di.scriminathins and re- 
sponses in a given number of trials. 
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1;*. Dt'x/tfity Test (CM116A) In this test the sub- 

ii’it s.it At .1 tiiblf 1)11 wliicli was a hoaid containing 48 pegs, 
'I'lic r.i''h was to lilt, turn, and replace the pegs in the board 
Sioring was in terms of the number of pegs lifted, turned, and 
I epl.iccd in ;i ttu'cn interval nf time. (For detailed desciiptions 
of ihc psyeiioiiiotor tests .see Melton (13)). 

Pilfil (Irilrriun. 'I'lie pilot criterion is the variable 
aLMi'iet whii li all of rlie classification tests described above 
were valid.ttcd. It is an artificially dichotomous criterion 
whicii t 'insisted (if information as to whether the trainee passed 
or failol at any of the progressive stages of pilot training Cor- 
relations heivveeii it and any of the remaining variables are 
hiseri.il cocfliticntsol correlation. 


’The Samples Studied 

The Restricted Grotip.—Ahev an individual made application 
for aircrew trainintr he took a qualifying examination Only 
tho.se imliviikial.s w lio made a prescribed mark on this test were 
sent on to clas.sification centers where they took the battery of 
cla.s,sificution tests, This qualifying, or "screening,” examina- 
tion eliminated from 40 to 60 per cent of the applicants. Thus, 
the sample of imlividuals who took the classification tests was 
curtailed, h'iictoritd studies on samples tested at classification 
centers were done on this kind of restricted sample. This con- 
stitutes one of the groups under consideration and has been 
designated the "Restricted group.” Data concerning factor 
loadings for tliivS group were simply taken from their original 
source (la), as will be described later. 

The Experimental Group . — This group consisted of men who 
were admitted to training without regard for scores on, the 
qualifying examination. This was done as a project designed 
to study selection and classification procedures. From the 
standpoint of the present study it is a significant samp e e- 
cause it was not restricted on a basis of either the qualifying ex- 
amination or the classification battery. This group is described 


in detail by Flanagan (7). , * -i- o • 

The iRasp Group.-^Th^ WASP (Women’s Auxiliary Service 

Pilot) group consisted of women who were in training to learn 
to fly army-type aircraft. No screening examination like that 
given to prospective aircrew members was used for their se ec- 
lon, but students had to present at least 35.hours of previous 
flying as a prerequisite for admission to training. The average 
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age of this ni'rtip was ^4 ye.us. Twrnty fne per renr of the 
group fi.ui tniiipicfc'l hiur or lu/irr years of'n)]!r4e and 40 per 
cent h;ui had some roilege training. Only ,5 per cent had not 
i't»ni]''leSeti hi^ii sihool. 

Cw«/vi;7 a;;; One basis fur lompari.son is the pro- 

portion of each moup aho\e the quaiifyinu .seoje nf the; screen- 
ing examination Of the gruiq' restrieted on a basis of this 
sente, of course, all ha\ e scores at or .aUme this qualifying mark. 
Of the Inperi mental lunrcstrictcih eroiqi 4^ per cent fell helow 
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thi.s qualifying score. Data arc not available for the specific 
sample of W.'XSP's .studied in thi.s problem, but stiulies on larger 
groups (iX) indicate that about jo per cent of the \V.-\SP group 
had .scores lower than the minimum qualifying score for the 
men. 

A more pertinent basis for comparison involves the means 
and SD's of the groups in the tests being atia!)ved, d'hc.se are 
shown in Table i. In.spection of Table i reveals several .sig- 
nificant comparisons: 

i) The Restricted group has higher mean.s than tioe.s the 
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Experimental group for all tests except the Biographical Data 
Tests. 

2) The .SD’s for the Restricted group are smaller than for the 
Experimental group for all tests except Biographical 'Data — 
J\'ai'igatot\ and here the difference is negligible. 

'^) The WASF's tend to be intermediate to the men’s samples 
with respect to mean.s and SD’s. They excel on some tests and 
are inferior in other.s. Tests in which they excel seem to be 
related to educational background, (Reading Comprehension, 
General Information. Mathematres); they tend to do more 
poorly than the men on the apparatus tests. An exception is 
the Kudihr Control 'Test, which may be the result of their ex- 
perience in piloting plane.s and manipulating rudder pedals. 

Tlicre seems little doubt that actual curtailment resulted 
from .selecting ti-alnces on a basis of the qualifying examination 
and classification battery. The extent is not definitely known 
but it .seems logical to assume that curtailment must also be in 
whatever factor.s are measured by the various tests of the bat- 
tery. When the Re.stricted and Experimental samples are com- 
pared for Pilot Slaninc, which is an index from one to nine 
based on a weigluctl average of all tests in the battery, signifi- 
cant differences are obtained with respect to means andSD’s.^ 
It seems relatively certain, then, that the thiee samples do 
represent different conditions of selection, Whether these dif- 
ferent conditions of selection will alter the factors isolated fiom 
the battery of tests is one of the primary considerations of this 

study. 


Intercorrelations of Tests 

Table a pre.sents the r’s among the test variables for the 
Experimental group. These r’s appear in DuBois 
c.g) a,s part of a larger matrix. The last row (variable 19) 
contains the biserial r’s between the pass-fail pilot criterion and 

each of the iH test variables. All other r’s are product-moment 

cocfiicients, I’hc r’s arc based on 1012 cases, while the means 
and SD’s reported in Table i are based on 1275 cases. T 
discrepancy is due to the fact that the r s are only for that sam- 

» Experimental tJroup; Mean » 4.08; SD = 2,06 
Restricted Group: Mean ” 
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pie th If luul records available for flight training. From the 
time of tesfinu until the time of graduation (or elimination) 
from training some records became unavailable. However, 
there is no reason to believe that the records lost to the study 
biased the sample in any way. 

.All but two of the rs in Table 2 are positive. The two nega- 
tive coerticicnts do not differ from zero appreciably (standard 
error of an r - .00 for a sample of this size is .03), 

I’able 3 presen t.s the r’s among the variables for the WASP 
sample.'^ This table has seven negative entries Of these, 
five involve the Dexterity Test. None are significantly 

different from zero. (Standard error of an r = .00 for a sample 
this size i.s .07) 

Intercorrclations are not presented for the Restricted group 
since these data were not analyzed as a part of this study. 
Tables of r's for this group and factor analysis results appear 
in Guilford frz). Pertinent data have been included m this 
.study for purpose.s of comparing factor loadings of tests. 

Factorial Analyses 

I’he matrices of intcrcorrelations presented in Tables 2 and 
3 were factor analyzed by Thurstone’s centroid method. The 
proccdure.s followed for a solution were as described by Guilford 
(10). 

One of the criticisms of the centroid method has been that 
there arc no criteria as to how many factors to extract from a 
given matrix of r’s. The indeterminacy of the number of fac- 
tors to extract is due in part to the fact that the standard errors 
of the factor loadings cannot be computed The number of 
factors, then, is left to logical considerations rather than to a 
mathematical rationale. 

One argument is that more factors should he extracted than 
will ultimately be used. Since the Important consideration is 
to find the meaningful common factors^ if extraction of factors 
is stopped too soon important amounts of the communalities 
among the tests may be left unaccounted for. When more 
factors are extracted than are needed, however, those factors 

>The rnemis, SD’s, and r’s for the WASP group were furnished by Col, Walter 
F, Deemer. 
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which aic in truth residuals cannot ordinarily be rotated into 
meaningful positions and the amount of variance attributable to 
them will be small --and they can be dropped from considera- 
tion. According to this logic the danger is in extracting too 
few factors ratlier than too many. Since the superfluous fac- 
tors will show up as residuals or meaningless aitifacts they will 
not influence the interpretation of the primary factors, but too 
few factors would be difficult to rotate to meaningful positions 
and wouhl leave important amounts of communalities unac- 
counted for. 

The criterion used in this study to determine the number of 
factois to extract was tlie contribution of the factors to the 
intcrcorrelations of tests. The r between two variables may 
be expressed as the algebraic sum of the cross-products of 
loadings in factors common to the two variables. Thus, the 
maximum contribution which a factor makes to any r can be 
determined simply by computing the product of the two high- 
est factor loadings in this factor. It is apparent that when 
thi.s product is less than the standard error of the correspond- 
ing r, the maximum contribution which this factor is making 
to the r is certainly no greater than chance. Any factor which 
docs not meet this criterion cannot be considered a common 
factor because it docs not contribute to the relationship between 
any tw'o variables an amount that could be considered signifi- 
cant. 

The centroid factors and the estimated and computed com- 
munalities of tests determined from the r’s of the variables for 
the Experimental group are presented in Table 4. Similar data 
for the WASP group is contained in Table 5. 

Eight centroid factors were extracted from the Experimental 
group matrix. Examination of the loadings for the eighth fac- 
tor reveals that the largest loadings are .159 and .176 for vari- 
ables I and 2 respectively. The product of these loadings is 
.0279. standard error of the original r between these 

tests is .03. According to our criterion, then, no more factors 
were extracted. Examination of the residuals showed but one 
higher than .04 and this also would indicate that not much more 
variance would be involved. 

Seven centroid factors were extracted from the WASP group 
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matrix. Thu stability of these r'a was not .so great as for the 
other group, having been based on a smaller N. It might be 
anticipated, then, that not so many factors could be extracted 
from this matrix. As a matter of fact, it did not seem possible 
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to rotate the last factor into meaningful configuration and it 
was retained as a residual. 

d’lie centroid method provides orthogonal leference axes 
which will satisfactorily account for the relationships observed 
among variahlcs. However, these centroid axes lack psycho- 
logical meaninu, and before an attempt is made to interpret 
them it is necessary to rotate the axes into more meaningful 
positions. To locate the new axes two principles of rotation 
are emiiloyeil. These are; (i) that the factor loadings should 
be pn.sitive within the limits of sampling errors (this criterion 
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is known as "positive manifold”); and (2) that there should be 
as many zero loadings in the final factor matrix as the configura- 
tions of points will permit (simple structure). 

The centroid factor matrices in Tables 4 and 5 were rotated 
with the principles of positive manifold and simple structure in 
mind. I'he rotated factor loadings are presented m Table 6 
and Table 7. Rotation was done graphically according to a 
method described by Zimmerman (29). Thirty-six rotations 
of pairs of axes were necessary to satisfy the criteria ol simple 
structure and positive manifold for the factors extracted from 
the Experimental group matrix. Twenty-two rotations suf- 
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ficed for tlic factors result ing from the \VAHP group matrix. 
Ixjadiiigs of less than ,20 were coiiMdercd as vamshintr entries 
(i.e., approaching zero). 

In Table H are presented the rotated factor loadings which 
w'ere obtained for the group (tf trainees re.strictcd on a basis of 
a qualifying examination. 'I’he battery is the .same a,s the 
battery analyzed in the present study, with some tests having 
been added. This tabic i.s 'I’ablc 28. 18 in (12). The table is 
reproduced in its entirety hut the ortler of variables ami fac- 
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tors has been rearranged 

to 

correspond 

to the identifying 


numbers for comparable tests and factors in the present study, 


Interpretation oj Factors 

Subjecting a matrix off’s to a factor analysis merely indi- 
cates the number of orthogonal reference vectors which can 
be postulated to account for the correlations in that table. 
Rotating the centroid reference factors to simple structureand 
positive manifold tends to make for a unique solution and to 
make the results more meaningful psychologically. There 
remains the task of interpreting the factors. It lias been Indi- 
cated that factors simply show the presence of common refer- 
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encc Viii-hibles for tlie tests analyzed. But the causes of fac- 
tors arc many and it is hoped, in most analyses, that the factors 
appcarin;^^ in the particular study will indicate some of the more 
fundamental dimensions which may be postulated to explain 
the results obtained, 

To determine the common causes underlying the factors ob- 
tained the usual procedure is to try to find that function which 
is common to all of the tests that are heavily loaded on any 

TABLE 8 

Rvtnted J'ud'H' fMJriizi ond Cnmniiinalities /or a Group 0/ Pilot Trainees Selected by a 

^uati/yittg Examination 
Factor 



VahaUc 

1 

II 

III 

IV 

V 

VI 

VII 

VIII 

3 X 

B.CS h* 

1. 

miN . . . 

iB* 

-o.I 

02 

06 

so 

-08 

—01 

os 

os 

-01 30 

1- 

HDl’ 

— 12 

-iCi 

10 

-0.1 

31 

—08 

S 3 

22 

-IS 

03 ss 

3. 

SC) I 

0.! 

18 

62 

0,3 

23 

07 

-09 

17 

00 

00 51 

4. 

■SO H , . 

01 

I.I 

S6 

—08 

II 

18 

II 

24 

20 

12 51 


U, Ctimii, .. . 

58 

48 

OQ 

—02 

os 

04 

33 

—02 

10 

09 70 

(. 

DR-TR .. . 


46 

38 

06 

as 

02 

-14 

36 

—02 

og 64 


MI' 

0.1 

20 

01 

03 

— 12 

17 

58 

38 

03 

06 57 

i 

If I 

29 

so 

ay 

-os 

IS 

— 02 

-0.1 

40 

— 10 

OS 4 S 


If 11 

1 1 

Ih 

a8 

01 

0,1 

09 

aa 

so 

02 

aa 48 

10. 

c;i 

. . 4.1 

-1 + 

29 

—08 

-08 

-04 

S 3 

as 

—06 

07 65 

11. 

Miitli A 



—02 

02 

3 <> 

os 

18 

08 

16 

07 61 

T •» 

Mtuli H . 

.E- 

58 

-Og 

-04 

12 

03 

12 

26 

14 

09 60 

I ) 

RI> 

..05 

— 10 

16 


0.1 

ay 

12 

as 

-07 

21 40 


iHC . 

, , 00 

“0.1 

15 

36 

—06 

lo 

30 

44 

—OX 

-16 47 

1 1. 

tx: . . . 

• isl 

11 

22 

47 

04 

I4 

IS 

46 

Dl 

-17 57 

16. 

Rf 

, . (V) 

2,1 

-0.1 

10 

01 

SI 

01 

28 

— 16 

-os 44 


DRT . . 

lo 

19 

24 

24 

10 

-05 

02 

39 

07 

-03 33 

18. 

ED 

. U 3 

02 

22 

51 

0,1 

-os 

-05 

IS 

— 08 

oa 35 

It;, 

an, 

I'c; . . . 

Ilistiirv 

■ f'.i 

08 

og 

—02 

08 

— 10 

08 

— 02 


-05 70 

at. 

(iccturaphv 

61 

j6 

15 

-08 

01 

ol 

12 

06 

58 

06 79 

22 

I’llV.'.lC'i . . 

. .. ss 

:i 8 

-03 

04 

— n 

II 

SI 

17 

II 


2 ^. 

DcctKliiiK 

. . >4 

46 

3' 

12 

—06 

-IS 

-17 

3a 

10 

ao SS 

2a. 

Voc.il!ul.ir>' . . 

71 


XI 

10 

04 

09 

— II 

04 


II 59 


‘Decimal iKtint.s have been omitted. 


particular factor. Sometimes the nature of the underlying 
cause seems quite obvious and the factor can be quite easily 
identified. In other instances the nature of this underlying 
cau.se is not immediately apparent and the factor cannot be 
named ca.sily. Usually some hypothesis can be formulated as 
to ihc nature of the factor and clues may be obtained whic 
lead to further investigation. In any event, the naming and 
interpreting of the factors cannot be done by the statistical 
computations themselves, but these interpretations represent 
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the investigator’s hypothesis as to tlie nature of the process 
which seems common to the group of variables identified by 
that factor. 

In the present study loadings of .30 and higher are considered 
significant. A loading of .30 accounts for 9 per cent of the 
variance of a test and it would seem that this much variance 
should not be overlooked. In the naming of factors, however, 
more weight is given to those tests having the highest factor 
loadings. In practice, if one were attempting to purify a test 
so that it would be a measure of but one factor, variances even 
smaller than .09 would be taken into account b'er the present 
we are concerned witli identifying the factors extracted. 

Factor 1 . — -The tests having the highest loadings on factor I 
for all groups are (5) Reading Comprehension and (ro) General 
Information. This factor seems verbal in nature. The math- 
ematics tests (ii and in) also appear to some extent. One 
hypothesis to account for this might be that the factor repre- 
sents ability to deal with any symbolic system — not verbal 
symbols alone. Mathematics B, it will be recalled, presented 
items in “story problem” form, and its verbal content might be 
explained on these grounds. However, for the Experimental 
group, Mathematics A, which dealt primarily with algebraic 
equations, has a higher loading on this factor than does Math- 
ematics B. Other tests also appear with minor loadings on this 
factor {vi%., (8) Instrument Comprehension I, (6) Dial and liable 
Reading, (7) Mechanical Principles, (9) Instrument Compre- 
hension II, and (4) Spatial Orientation II)- Mechanical Prin- 
ciples appears with a significant loading for the WASP group. 
No mechanical factor appeared for them, and one hypothesis 
is that this test is a generally intellective one for them. The 
remaining tests, it should be noted, have rather long and com- 
plicated directions in common. It is possible that compre- 
hension of these instructions (verbal comprehension) is repre- 
sented here. The general nature of the function represented 
by the factor seems quite clear. It has been designated verbal 


(V). 


Factor II. — Tests having consistently high loadings for this 
factor for each sample are: (12) Mathematics B, (il) Mathe- 
matics A, and (6) the Dial and liable Reading Test. An in- 
spection of the tests to determine the common element 
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immediately suggests the numerical content. This factor, ac- 
cordingly, can be designated as numerical (N). The relatively 
high loading of the Reading Comprehemion rest on this factor 
for the WASP and Restricted groups is of interest, as are the 
loadings of tlie mathematics tests on the verbal factor. It is 
possible that there is an underlying second-order factor which 
might be described a.s a “general intellective” factor reflected in 
these loadings. 

RactoT II [~ I he spatial Orientation rests and 4) have 
consistently high loadings on factor III for all groups. The 
loadings of the Instt urnent Comprehension rests (8 and 9) and 
Oial and rable Readmg rest (6) are somewhat lower. These 
tests have in common the requirement that the subject be able 
to pick out and react to details in a rather complicated presenta- 
tion of stimuli. In the Spatial Orientation I rest the subject 
has to match small parts of a photograph with the correspond- 
ing area in a large photograph. In Spatial Orientation II 
rest small photographs are matched with corresponding areas 
on maps. 1 n Insh'iirnent Comprehension I relevant aspects from 
a set of dials must be picked out from a group of five items de- 
scribing the dials. In the Dial and rable Reading rest dials 
and tables must be read quickly and accurately. The speed 
with which one can accomplish each of these tasks is associated 
with the score made on the test This factor has been called 
the perceptual speed factor (P). 

F'actor IF . — ^'rhe four most consistent tests for this factor are 
Rotary Pursuit (13), Finger Dexterity (18), Complex Coordina- 
tion (15), and the rivo-hand Coordination rest (14) The com- 
mon element is immediately apparent — they are all psycho- 
motor tests. All the tasks involve some form of motor 
response and of coordination between various members of the 
body. The Rotary Pursuit rest involves eye-hand coordination 
and rhythmic use of the hand and arm. Finger Dexterity 
involves the use of smaller muscle groups and a close coordina- 
tion between these and the eyes. The Complex Coordination 
rest involves eye, hand, and foot coordination of a relatively 
gross nature. The rvoo-hand Coordination rest involves the 
simultaneous use of both hands and the coordination of these 
movements with visual cues. This factor has been called the 
psychomotor coordination factor (PM). 
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Factor F. — An examination of factor loadings shows factor V 
is comparable only for tlie Experimental and WASP groups, 
Tests having significant projections are; Biographical Bata 
Blank-Pilot (2), General Information (10), and Bio^-aphical 
Data Blank-Navigator (i). The variable common to these 
tests seems to be an interest in aviation. Both biographical 
data blanks contain numerous items which indicate an interest 
in aviation, as does tlie General Information Test, d'he indi- 
vidual who read articles about the various planes would do well 
on the first part of this test, while the individual who familiar- 
ised himself with technical terms and those specific to flying 
would do well on the second part. It seems a reasonable hy- 
pothesis that this factor reflects interest in flying, and it has 
been labeled the aviation interest factor (AT). 

No factor called aviation interest was isolated for the Re- 
stricted group. Factor V for this group was called “mathe- 
matical background” apparently because of its projections on 
the Biographical Data Blank- -Navigator and on Mathematics A. 
The validity of mathematics for navigators had been demon- 
strated. Howevei, a minor projection appears on this factor 
for Biographical Data Blank — Pilot, and this is 1 nthcr difficult 
to interpret in terms of mathematics background. Also un- 
usual, if this is mathematics background, would be the lack of 
a significant loading for the other mathematics test, It is 
probable that further rotation might make it more meaningful. 
At best the factor has but one significant projection for this 
group — that on Biographical Data Blank — Navigator, and it is 
difficult to Interpret on this basis alone. 

Factor VI. — Factor VI contains no very significant loadings 
for any of the groups. For the Experimental and WASP 
groups it seems most closely related to a factor which has been 
called visualization (Vz) in other analyses. This is suggested 
by the loadings on the Instrument Comprehension Fests and on 
the Complex Coordination Fest. Elowever, the loading for the 
Dial and Fable Reading Fest for the WASP’S cannot be accounted 
for readily on this basis. The interpretation of this factor 
must remain rather tentative. For the Restricted group h'actor 
VI was called a kinesthetic factor, but again this is rather doubt- 
ful since it has but one significant loading (in Rudder Control). 
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Factor r//.— For the WASP group this factor could not be 
rotated into meaningful position and has been called residual. 
For the men’s populations, however, it has loadings in Mechan- 
ical Principles, two-hand Coordination, and, to some extent, in 
Biogi-aphical Data Blank— Pilot. All of these have already 
shown major or minor projections on one of the factois pre- 
viously discussed. An examination of these tests suggests that 
the common element is mechanical experience. It seems 
reasonable that mechanical experience might be associated with 
performance on the two-hand Coordination test, where the 
handles with wliich the stylus is manipulated resemble the 
handles on a lathe. The mechanical content of the Mechanical 
Principles test is obvious The Biographical Data Blank — 
Pilot also contains Items which indicate mechanical experience. 
This factor has been called mechanical experience (ME). 

Factors J'lIJ and IX. — For the Restricted group Factor VIII 
was called space (SP). For the Experimental group there are 
no very significant loadings but the trend is such that its simi- 
larity to this factor is suggested. Factor IX, found only in the 
Restricted group, was called a social science background factor. 

General interpretation.' It has been possible to identify five of 
the factois found in the analyses of the Experimental and 
WASP groups with a fair degree of assurance. These factors 
were found in parallel form in the Restricted group. The 
factors whicli could be identified were verbal, numerical, per- 
ceptual speed, psychomotor coordination, and aviation interest, 
It was not so easily possible to interpret the remaining factors. 
One seemed clearly to be mechanical experience. A tentative 
hypothesis is that the others represent abilities called visualiza- 
tion and space. Because of the dearth of significant loadings, 
however, their identifications must remain rather tentative. 
If tests that were purer measures of these factors had been in- 
cluded in the battery it might be anticipated that the nature of 
these factors miglit be made more clear. 

Summary and Conclusions 

The purpose of this study was to determine empirically the 
effects of selection of samples upon factors isolated from a bat- 
tery of tests. Three samples of pilot trainees representing dif- 
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ferent selective conditions had taken a comparable battery of 
tests. Correlation matrices were factorially analyzed for each 
group by the centroid method. The re.sulting factors were com- 
pared. It was possible to conclude that similar primary fac- 
tors will be obtained when a battery of te.sts is administered to 
groups representing different selective condition.s. The re- 
sults suggest that primary factors arc meaningful descriptive 
parameters which are not merely reflecting the particular selec- 
tive conditions represented in the various groups. 
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THE ROLE OF CLIENT TALK IN THE 
COUNSELING INTERVIEW 


EARL F, CARNES and FRANCIS P ROBINSON 
Oliio State University 

Recently a number of studies have been made of the dy- 
namic relationships involved in the counseling interview (3, 4, 
8j 9). A promising methodology for studying the interview 
has evolved; a recent trend has been an examination of the 
relationship of single variables within the interview to other 
counseling procedures and outcomes (i , 10) . The present study 
is an example of that trend. 

Extensive counselee talk is considered by many to be an 
important attribute of effective counseling (2, 3, 6). In the 
first placEj a counselee’s willingness to talk is usually sympto- 
matic of a good working relationship between client and 
counselor. A reticent or resistive client tends to speak briefly 
or even to be silent; free talking is taken as a good sign. As a 
result, many counselors try consciously or unconsciously to 
enhance its occurrence. Extensive counselee talk is also valued 
by many for a second reason. It is felt that free verbalization 
tends to bring more material out at a conscious level and until 
there is verbalization by the counselee, there can be little 
growth in insight The assumption, apparently, is that verb- 
alization results in insight. Like most other variables in the 
counseling area, however, the importance of client talk has not 
been objectively studied. This paper proposes to examine the 
relationship of the amount of counselee talk to the effectiveness 
of counseling. 

Method 

Source of Data , — The interview typescripts used as the raw 
data for the study were obtained from a counseling practicum 
offered at Ohio State University About half of the data came 
from interviews conducted by experienced counselors, some of 

63s 
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whom were supervisors of the course and others of whom were 
not ordinarily a part of the course. The remainder of the data 
came from the counselors-in-training. Counselecs consisted 
of students in a how-to-study course, who met for a weekly 
interview with counselors over a period of a quarter to discuss 
problems related to their study difficulties (5). While study 
problems are emphasized, clients bring up all types of problems. 

The interviews were recorded and verbatim typescripts made 
of the recordings. Use was made of 78 such typescripts in 
this study. Of this number 42 interviews were conducted by 7 
experienced counselors and the otlier 36 by 16 counselors-in- 
training. 

Classification System . — In the analysis of an interview, the 
most advantageous unit has been found to be all the counselor 
and counselee discussion related to one main idea or problem. 
Sherman (8) found it possible to recognize with a high degree 
of consistency the transition points at which the conversation 
changes from one topic to another, and the unit then consists 
of all the conversation between two transition points. A 
typical interview may consist of one or many such units. For 
the 78 interviews used in this study, the range was from i to 15 
units per interview. The total number of units used was 353. 

The most meaningful measure of the amount of client talk is a 
ratio of the amount of client talk to the total amount of talk in 
the interview. For ease of reference this ratio will be called 
the “talk ratio” and will be presented in decimal fractions. As 
an example, if the talk ratio is .25, it is apparent that the 
counselee has done 25 per cent of the talking, 

It is proposed to study the relationship of the amount of 
client talk to the topics, techniques, and outcomes of interview 
discussion units. While some other topics were discussed, this 
study will be made only on the units dealing with the four 
most common topics, i.e., study skills, vocational problems, 
therapy, and scholastic questions (information seeking). 

In any given unit several techniques may be commonly used, 
but it has been found that one usually stands out as predomi- 
nant in the conduct of the interview. This has been labeled the 
“primary technique.” Each counselor response in a unit was 
tabulated on a check list of the various possible techniques and 
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the primary technique was then determined on the basis of its 
frequency or importance for the total unit. In the present 
study, units were included which were characterized by the 
primary use of one of four techniques. The definitions of 
these four, arranged in the order of increasing amounts of 
counselor lead, follow: 

I, Clarification: The counselor states the feeling or problem 
of tlie counselee in such a way that it can be more clearly 
understood and used in the interview, but he does not inter- 
pret the counselce’s feelings or problem, nor does he add 
any information or suggestion of his own. 

a, Tentative Anahsis: The counselor presents a conception of 
the problem being discussed but does so m a purely tenta- 
tive manner. The client feels fieedom to accept, modify, or 
reject the idea. The counselor is not attempting to push the 
counselee toward a given idea, but is setting up ideas for 
analysis. If, following a statement of the counselee, the 
counselor asks a question of the “tell me more about that” 
type, it is also consideied tentative analysis. 

3. Interpretation; Tlie counselor verbalizes his conception of 
tlie problem and states it positively enough that the coun- 
selee feels that it is presented for his acceptance. Data may 
or may not be given to support the mterpretation. As pre- 
sented the interpretations seem objective and obvious and 
the counselor’s values do not seem to be involved. 

4. Urging: The counselor not only presents his conception of 
the problem but gives advice on its treatment. The client 
definitely feels that he is being pushed toward acceptance. 

It often contains phrases like “I want you to” or You 
should.” Data may be used to support the argument. 

The counselor’s values seem to be involved here. 

As evidences of interview outcomes, three variables were 
used; (l) growth in counselee insight, (2) working relationship, 
and (3) client responsibility for the progress of the interview 
These factors are admittedly difficult to objectify, but the most 
feasible means of doing so seemed to be by the use of rating 
scales. Five-point rating scales, carefully worked out by 
Sherman (8), were used in this study. While the reliability o 
results obtained from rating scales are not particularly high, 
Sherman found that these rating scales produce resu ts a e- 
quate for the comparison of group averages used 

A distribution of the units used in the study, classified by 
topic and primary technique, is shown in Table i . 
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Results 

An analysis of the 353 units shows that there was a wide 
range in the amount of conselcc talk from one unit to another 
One counselee talked as little as 4 per cent of the total, another 
talked 89 per cent of the total. The individual counselors 
differ considerably from one another in the mean talk ratio of 
their units, but each tends to be consistent from one unit to 
another. Among the nine counselors wlio contributed the 
largest number of units to the study, the individual mean talk 
ratios ranged from a low of .a6 with a standard deviation of .15, 
to a high of .67 with a standard deviation of .21. The data 
were analyzed to determine whether the experience of the 
counselor had any effect on the talk ratio, but the experienced 

TABLE 1 

Diiliiitilitiii of Units Classified by Topic and Pi unary Tecbniqui 

C'lann- Tfntdlive Inleriire- 

(iition Aniilyi.111 inlinn Urginit Totals 

Studv Skills 44 24 bS 36 ^47 

Schola-stic Questions 33 23 37 7 100 

Therapy 13 n 33 9 66 

Vocational Problems 1 10 42 7 40 

Totals 71 66 ^ 117 S9 353 

counselors and the counselors-in-training, as groups, liad almost 
identical distributions of talk ratios. 

The relationship between the talk ratios and the rated 
amount of insight growth achieved by the counselee on each 
unit was studied. The correlation between these two variables 
for all units is .25 ± .05. Sherman (8) found that insight 
ratings were her least reliable measure. Judges had particular 
difficulty in rating short responses. What is'one to infer about 
insight from a counselee response of “Mm hm”? It is quite 
possible that judges tend to rate down brief counselee remarks, 
in which case a low talk ratio would tend to receive a low insight 
rating. If we accept Shaffer’s (7) definition of insight as “a 
verbalization of the person’s problems and of the relationships 
between them,’’ perhaps such a low rating is justified. 

Logically the amount of counselee talk seems to be a function 
of the working relationship. In the low ratings of working 
relationship, where the counselee is resistive, he is apt to speak 
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in monosyllables or perhaps to merely nod his head in silence. 
On the other hand in the high ratings, there is mutual give and 
take and each party feels free to talk. The coefficient of cor- 
relation is .31 ± .05. Further details of the relationship be- 
tween the two variables is evident from a glance at Table 1. 
The distribution shows that working relationship is virtually 
always judged to be good when the talk ratio is high; out of 71 
units with a talk ratio over .60, only 8 show a working relation- 
ship rating of less than 4. However, a high talk ratio is not 
the stnc qua non of a good working relationship; this is shown 
by the fact that out of 181 units with a talk ratio of less than 
.40, 98 were still classed in the highest two ratings of working 
relationship. In short, a high talk ratio is not necessary to a 
good working relationship, but it is good insurance. 

TABLE 4 


Disiril/iilion of Talk Ratios of Units Accord'ms to Their Working Relationship Scores 


WorkinK 

B.ckliun4lu(i 

O-.IO 

20-,39 

Talk RaUos 

40- 59 GO- 79 

.80-99 

Total 

5 

3 



20 

8 

74 

4 

y 

6a 

6 a 

31 

4 

s68 

.3 

30 

47 

8 

I 

0 

66 

2 

s 

17 

12 

5 

I 

40 

I 

1 

3 

0 

I 

0 

S 


4 S 

133 

lOI 

S8 

13 

353 


The most clear-cut relationship found in the study is between 
the talk ratio and counselee responsibility for the progress of 
the unit. The coefficient of correlation is .66 ± .03. It is 
evident that the person feeling primary responsibility for 
directing the course of the interview tends to talk the most 
Up to this point, overall relationships have been examined. 
The question now arises, what happens to these relationships 
when different topics or different primary tecliniques are 
studied ? It may be that the amount of talk is more important 
with some problems than others. One would logically expect, 
for example, that insight concerning study skills would come 
from having an expert explain effective study techniques more 
than from counselee verbalization of his difficulties, since 
effective study depends upon information as to correct tech- 
niques. In therapy, on the other hand, there is more need for 
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growth in self-understanding through verbalization of vague 
fears than for the acquisition of information. 

When the units are grouped by topics and the talk ratios are 
tabulated, it turns out as expected that the lowest mean ratio 
(.36) occurs in the units concerned with study skills. The 
other three topics, in which the counselee discusses his problems, 
all have about the same mean talk ratio (.43“.48). Therapy, 
with its emotional loading, docs not here result in more talk 
than other personal problems. 

An analysis was made to determine whether the relationships 
between talk ratio and growth in counselee insight and be- 
tween talk ratio and working relationship were affected by the 
topics of the units. Results are shown in Table 3. 

The topic of the unit apparently has a marked effect on these 
relationships. An explanation for the low correlation between 


TABLK 3 

Amljsii by Topics oj the Corrtktion of Talk Ratios to Insight and to IP'orking Relationship 


Topic 


(irowlh In Tntixlil 
vs. T*lk Ralio 
(r) 


WorkInK Relationship 
vs Talk Ratio 
(r) 


Study Skill!! 09 .35 

Scholnstic Questions 43 49 

Therapy aj .11 

Vocational Problcnns tio .6j 


talk ratio and insight in study skills has previously been sug- 
gested, i.e., growth in insight in study skills may not necessarily 
come from client conversation so much as from counselor 
description of correct study techniques. However, the low 
correlation in therapy looks out of line. Because the sampling 
of counselors in this study included some persons highly in- 
terested in a non-directive approach to therapy problems, the 
counselors who conducted the therapy units were divided into 
two groups; those considered essentially directive and those 
essentially non-directive. This grouping was made without 
knowledge of the talk ratios by a staff member, who has been 
closely associated with all of the counselors involved. The dis- 
tributions of talk ratios for the directive and the non-directive 
counselors are shown in Chart I. 

On the basis of this division, the 23 therapy units conducted 
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by non-directive counselors yielded a mean talk ratio of ,66 
and an average insight score of a.35. The 43 directive units 
yielded an average talk ratio of only .cig, but also an average 
insight score of a.4Q.. 

Coefficients of correlation between insight and talk ratio were 
computed for each of these two groups. For the non-directive 
group, the coefficient was .39 ± ,18, and for the directive 
group it was .36 ± . 11 , as compared to .25 ± .05 for the two 
groups combined. The reason for this is that in non-directive 
therapy there is a bunching of units at the high end of the talk- 
ratio scale, whereas in the directive therapy there is a bunching 



(M),i .u-.ia. ,n-.K .U -.50 .6X-.70 .71-.S0 .ei-.jo . 71 - 1.0 

Talk II4U9S 


Chart 1 . Distribution of Talk Ratios of Directive and Non-directive Counselors 


at the low end of the scale. Combining the two groups causes 
a large standard deviation of talk ratio, which in turn decreases 
the correlation coefficient. 

These results for directive and non-directive counselors show 
that the amount of client talk is related to insight, and that 
clients of non-directive counselors talk the most. But the 
results also show that it is the relative amount of talk for a 
given counseling system, and not the absolute amount of talk 
that is related. The best probable interpretation of these 
results is that the system of counseling tends to set limits to the 
amount of counselee talk, and within these limits counseling 
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situations giving rise to insight lead to more talking. It is not 
clear that trying to get more counselec talk will necessarily 
lead to more insight, 

A similar analysis of the low correlation in therapy units 
between talk ratio and working relationship yields a somewhat 
similar result in that both the directive and the non-directive 
groups alone get higher correlations than do the two combined, 
However, in this case the correlation coefficient for non-directive 
therapy is considerably higher (.38 ± .18) than in directive 
therapy (.17 ± .15). 

The final factor in this investigation which appears to be 
related to the talk ratio is the primary counselor technique. 
The distribution is shown in Table 4. 

The primary techniques are arranged in order of increasing 
amounts of counselor lead. It is apparent that in general there 

TAI«.K 4 

Re/aiionship Rettecen Talk Katw ami I'rimaiy Technique 

Talk Rallt> 

0.15 .20-,35 ,|i) ..VJ W 75 RO-'W Mn SI) 

CLarificution S I4 3a 16 (t .51 .icj 

Tentative Analyijis a u) 24 117 4 .52 18 

Interpretation ai 71 41 ai 3 .30 ,19 

Urging 34 20 4 a o .26 .15 

is an inverse relationship between the amount of lead and the 
talk ratio. Little difference is seen, however, between the talk 
ratios for clarification and tentative analysis, 

The relationship between amount of lead and talk ratio 
suggests that the amount of lead has influenced the correlations 
between talk ratio and interview outcomes. In a similar way 
the topic has exerted an influence. A rough control of these 
two influences may be obtained by using derived scores, i.e., by 
grouping units according to topic, subgrouping the topics by 
primary technique and subtracting from every member of 
each subgroup a figure equal to the mean talk ratio for the sub- 
group, Thus a client who talks more than the average client 
does when a particular topic is discussed and a particular coun- 
seling technique is emphasized, probably wants to talk, Is this 
measure of willingness or lack of willingness to talk related to 
interview outcomes ? Such a method should give a somewhat 
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more accurate picture of the relationship between talk ratio 
and outcomes, independent of techniques and topic 

For the topic of study skills, the correlation between talk 
latio and insight, using derived scores, is +,04, and the cor- 
relation between talk ratio and working relationship is -f-.i2. 
For tlie decision-making topics, the correlation between talk 
ratio and insight is +.39) between talk ratio and working 
relationship is +.23. There is again an indication that in 
study skills, talk ratio is not an important factor. It seems to 
be somewhat more important in the decision-making units. 

While this study has consistently shown low positive rela- 
tionships between amount of client talk and worthwhile out- 
comes, the causal relationship is not clear Detailed analysis 
has shown that counseling systems tend to set patterns affecting 
the amount of talk, within these limits, the relationship of 
talk and outcomes is higher. Insofar as the amount of talk is a 
symptom of outcomes it may be welcomed as a sign of effective 
work by the counselor. Insofar as increased amount of talk 
may aid in clarifying problems, the counselor may build his con- 
ference to obtain it. While the direction of causality and the 
degree of importance of the possibilities cannot be assessed, it 
is clear from the evidence at hand that very low ratios of 
coLinselee talk are often bad. Great care will have to be taken, 
however, not to overemphasize amount of talk as a criterion in 
counseling. Emphasis on the amount of counselee speech may 
direct the conference to safe topics on which the client talks 
easily or even to social visiting. Amount of talk should be 
considered only a very minor criterion of counseling effective- 
ness 

Summary and Conclusions 

Typescripts of 78 counseling interviews (353 discussion units) 
were analyzed to determine the relationship between the 
amount of client talk and the following variables; topic, coun- 
selor technique, growth in counselee insight, working relation- 
ship, and counselee responsibility for the progress of the unit. 
Amount of client talk yielded a low positive correlation with 
growth in client Insight and with working relationship, and a 
more marked correlation with client responsibility for the prog- 
ress of the interview. 
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The topic of the unit exerts an influence on tlie relationsliip 
between amount of client talk and insight growth. In study 
skills this relationship is virtually zero. In various types ol 
personal problems, it is large enough to seem important. In 
therapy, non-directive counselors obtained much more counselee 
talk than did directive coun.selors but tlicse large amounts of talk 
were no more highly related to insight. The topic of the 
unit exerts a similar influence on the relationship between 
client talk and working relationship. 

In general there is an inverse relationship between the amount 
of lead in a given counselor techniq^ue and the amount of client 
talk. 

The causal relationship between amount of client talk and 
desirable interview outcomes is not clear. Therefore, it is not 
possible to use the amount of client talk as a criterion of 
counseling effectiveness. 
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THE RELATIONSHIP BETWEEN VALUES, CONCEPTS 
AND ATTITUDES 

ASAHEL D, WOODRUFF 
and 

FRANCIS J. DiVESTA 
Cornell University 

Previous studies of the value patterns of individuals have 
shown that values are clearly related to behavior (5, ii, 13, 18, 
19). The relationship seems to be something along the follow- 
ing lines. As a result of experience, the individual comes to 
value positively certain objects and conditions which have 
seemed to contribute to his well-being. Those objects or 
conditions wliich seem to him to have interfered with his well- 
being become colored with a negative value. Variations in the 
value attachments presumably depend on the amount of 
contribution or interference the individual has experienced in 
connection with the objects or conditions. The result of this 
process is a pattern of values running from high positive 
through neutral to high negative strength. In any behavior 
situation, an individual tries to act in a way which will get 
him more of his positive values and less of his negative values. 

Before dealing with values in research studies, it is necessary 
to become somewhat clear as to the level of generality or speci- 
ficity involved in the value categories to be used. Value can 
be attached at such levels of specificity or generality as a 
particular food, a pet, a type of social event, a general charac- 
teristic of people, or a generalized condition of living. Many of 
the most used concepts in American society are of the latter 
type and include such concepts as having home life, possessing 
wealth, engaging in excitement, doing socially useful things, 
and so on. Accordingly the senior writer has defined a “value” 
as a generalized condition of living which the individual feels 
has an important effect on his well-being. Individuals who 
value home life may differ as to the details which make up their 

64s 
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concepts of lionie life, but they do value home life more, for 
example, than excitement, or personal improvement, or some- 
thing else. Hence they will conduct their affair.s so as to 
promote more home life rather than le.ss home life, and in 
preference to more excitement, or per.sonal improvement as 
the case may he. .Speaking generally, an indiviilual will try 
to promote all of hi.s higher po.sitive valuc.s as opportunity 
permits, but each value will have precedence over those below 
It in his pattern, when a conflict between value.s develops. 

Preliminary 'trial 

One of the interesting hypothe-scs which grows logicallyoutof 
the belief that values arc governing factors in behavior, is 
that values play something of an important role in tlie de- 
termination of expres.secl attitudes. If this can be established 
as a fact it will have an important effect on research in atti- 
tudes, One thing it will demonstrate is that attitudes are 
behavioral responses to something more central and more 
stable in the individual's mental make-up. 

As a preliminary approacli to this hypothesis, a group ofya 
students in a finst course in psychology were subjected at the 
beginning of the term to a scries of tests, d Htudy of Choices 
(17, 18) was aclministerctl to obtain their value patterns, and 
Thurstone’s scales for measuring attitude toward Communi.sm, 
Sunday Observance, and Evolution were administered, For 
each student a data card was made up which showed his atti- 
tude scores on the three attitude .scales, and the rank in his 
pattern of each of the twenty-four values contained in the test 
of values. Intcrcorrelations were computed between all of 
these variables, and the values were arranged in three lists, one 
for each attitude, in the order of the intercorrelations as shown 
in Table 1. 


Inferences For Siudyhig Subyectioe Views 

Nothing conclusive is established by these data, but they are 
highly suggestive. There seems to be a clear tendency for the 
intercorrelations to be high positive when the subject of the 
attitude score would seem, on a commonsense basis, to con- 
tribute toward the value in question. Thus, Sunday obser- 
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vance would seem to be contributory to the realization of 
church activity, and religious living, and in a lesser sense to 
the promotion of service to others, and to family life. Also, 
Sunday observance would seem to be detrimental to the 
realization of relaxation and recreation, and to excitement. 
Furthermore, the values which have intcrcorrelations around 
zero seem, on the whole, not to be greatly affected by the 
subject of the attitude test. 

In arriving at the tentative conclusions just outlined, it is 
necessary to reach for what one might conceive to be the sub- 
jective interpretations of the typical undergraduate student. 
The objective facts about any existing relationship between 
Sunday observance and recreation arc of no importance here, 
because we are dealing with the subjective and personal re- 
actions of individuals Therefore, it becomes necessary to 
recognize certain stereotyped concepts such as the idea that 
evolution is contrary to traditional religious thinking and is 
therefore anti-church and even anti-religious living. Under 
that a.ssumption we obtain what seem to be reasonable relation- 
ships between values and attitudes, but it is clearly necessary 
to be much more precise as to what each individual’s concepts 
are if we arc to trace the relationship between values and atti- 
tudes with real validity. 

Remion 0] Hypothesis 

With this hunch, the hypothesis was revised to read as 
follows. An individual’s attitude toward any object, prop- 
osition, or circumstance will he, favorahk If, according to his 
concepts, that object seems to favor the achievement of his 
strong positive values. His attitude will become unfavorable 
if any change in the situation, or in his concept of the object, 
makes it seem to him that the object endangers his strong posi- 
tive values. Conversely, one’s attitude toward any object, 
proposition, or circumstance will be unfavorable if, according 
to his concepts, the object seems to threaten his strong positive 
values. His attitude will heeotste favorable if any change in 
the situation or in his concept of the object makes it seem to 
favor his strong positive values. The strength of the attitudl- 
nal expression will be a function of the importance of the 
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values to which the object or condition has any relationship 
and the extent to which the person feels the object or condition 
will affect his values. 


Procedure 


A new class of 84 students just beginning the first course in 
psychology were used as subjects. A Study oj Choices (17) 
was used to obtain the value pattern of each one. Remmers’ 
Generalized Scale for Measuring Attitude Toward Any Pro- 
posed Social Action was used to determine the students’ 
attitudes toward the proposed abolition of fraternities and 
sororities from American colleges. Each student completed a 
trial form of a concept test, to obtain a description of his con- 
cept of fraternities or sororities. The concept test consisted of 
two parts. One was a sheet on which appeared the following 
material, with appropriate spaces for writing: 


If the abolition of sororities and fraternities were adopted 
by American colleges it would have certain effects on individ- 
uals such as you. Using your best judgment, even though 
you may not have facts upon which to base it, make a brief 
answer to each of the following questions. 

I. What would happen to you? 

Would it be good •— — , bad , or neutral ? 

2 What would happen to YOUR BEST FRIENDS? 

Would it be good ,bad- , or neutral—? 

3, What does it mean? What would it be like? lell what 
you think the action would involve or include? In other words, 
describe what you think would take place. 


The other sheet was set up in the form of a rating scale on 
which a series of questions could be answered by checking one 
of five positions: Very Detrimental, Mildly Detrimental, Neu- 
tral, Mildly Beneficial, and Very Beneficial The instructions 
and the questions were as follows: 


Check. List on Sororities and Fraternities 

Place a check mark on the line below each question in a posi- 
tion which indicates the amount of benefit or detriment you 
believe is involved. The center of the me is always a neutral 
point, with beneficial effects to the right and detrimental et- 
fects to the left. Use the descriptions above question num ber i 
as a guide. 
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I. How do they aftect their mcmber.s htmially during college 
yeai s? 

1. How dll they alTeri inemhei<* hchol.isrii'ally during college? 

3. How do they affect riieinhers ffnancially during college? 

4. How do tliey affect ineinheiw (norally during college? 

5. How do they affect ineinherc socially after college? 

6. How do they affect niemher', financially after college? 

7. How do they affect nicinhcrs imirally after college? 

8. How do they affect non-ineiniicrs socially during college? 

9. How do they affect tuin-mcinbcrs scholastically during 
College? 

10, How do they affect noii-incinbers linancially during col- 
lege? 

11. How do they affect non-members morally during college? 

la. How do they affect non-members socially after college? 

i.y How do they affect mm-members financially after college? 

14, How do they affect mm-members iut>rally after college? 

15. How do they affect American social life generally? 

The concept tests arc obviously constructctl on the assump- 
tion that things mean to us what we believe they do to us. 
This is clearly substantiatal by the responses of children to the 
Binct, and the answers which are crediletl at tlic early age levels. 
It is also supported by the role theory of Cottrell (i), who speaks 
of these functitmal meanings as self-other roles incorporated in 
the individual througli his interactions with otlier social ob- 
jects. 

The test of values was scored in the usual manner, and for 
each student a data card was set up on which liis rank-order 
arrangement of the twenty-four values appeared. In the 
scoring procedures tor this test (18) it is possible to determine 
whether the individual discriminates between two subdivisions 
of a generalized value. If he did not do so, those two elements 
were listed as one in this study. This is significant, because 
only the five highest values, whether they were subdivided or 
not, were used in each case in subsequent treatment of the 
data. Thus the values used in one person’s case might not be 
the same as those used in the case of another person, except that 
they would always be the highest five for each student. This 
was done in order to restrict die test relationship to the strong- 
est values for each person, and thus let significant individual 
differences exert their maximal weiglit in the results. 

The attitude test was scored in the usual manner, and the 
score recorded on the data sheet for each student. 
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Ihe concept clieck-sheet was scored in two steps. First the 
five conceptual elements in it were jotted down on the side of 
tlie sheet. These were social life, intellectual life, moral life, 
economic life, and general American social life. Next a count 
of the check marks was made, in which zero checiks were ig- 
nored, “i” checks were counted as l, and “a” and “3” checks 
were counted as 1 . Those on the beneficial side were given 
plus ratings, and those on the detrimental side were given minus 
ratings. Opposite each of the five elements was shown the 
algebraic total of the check marks. Thus one student had plus 
2, and minus 1 for society, minus i for moral, and minus i for 
economic. All of his other checks were at the zero position or 
neutral. This summarizes his expressed concept of what a 
fraternity does to a person, namely, it has mildly beneficial 
social effects and mildly detrimental moral and economic 
effects, but in the main it has very little total effect. In com- 
parison with most of the students, this person’s concept is very 
close to being a blank, an interesting phenomenon which 
will be discussed later. 

The other concept sheet, requiring free-response answers, was 
read carefully for any content which revealed the individual’s 
functional concept of a fraternity or sorority. For example, 
here is one response to the first question: “What would hap- 
pen to YOU?” 

First, I would not have as pleasant an opportunity to work (i), 
as working in a fraternity has helped me considerably towards 
seeing me through college (a). I would have no “home” at 
college (3), and none of the close friendships that I enjoy (4) 

I would not have the pleasure of working and living with a 
group (5), nor would I be able to enjoy the outside friend- 
ships (6) to which the group has introduced me. 

The numbers inserted in the quotation are to identify the 
interpretations, which were listed as follows: 

fi) Comfort, plus I. 

(а) Economic advantage, plus 2, 

(3) Home life, plus 2. 

(4) Friendship, plus a. 

(5) Society, plus i. 

(б) Friendship, plus i. 
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A notation of “plus l" indicates that the scorer felt this 
comment indicated a belief that a fraternity conlributcd mildly 
to one’s comfort. A notation of “plus a” indicates the com- 
ment showed a belief in a somewhat .stronger effect. In the 
quotation above, for example, the wonl "considerably” seemed 
to give emphasis to the comment. In view of the subjective 
nature of this scoring, both experimenters scored the papers 
separately, and then diseu.s.sctl those j^apers on wliich they 
differed. Such papers were in the minority. This was done 
before either experimenter had an opportunity to associate a 
value pattern or an attitude score witli the name of the in- 
dividual whose slieet was under liiscu.ssion. 

In order to equate these quantitative concept scores to the 
value pattern, “moral” was assumed to be roughly equivalent 
to the value “religion,” “social” to “society” in the value test, 
“financial" to “wealth” in the value test, and “scholastic” 
to “intellectual activity” in the value test. 

The scores derived from eacli student’s concept tests were 
next set opposite tlie values to which they were related in his 
value pattern. Note tliat these values are in a unique order 
for each person, so tiiat wealth might be high for one, and low 
for another. Therefore the comments made on wealth would 
be recorded at various places in the patterns of different 
individuals, depending on where they had ranked the value 
“wealth.” It follows that there would not necessarily be any 
scores recorded opposite the five highest values in a given stu- 
dent’s pattern. For some students the five highest values 
seemed to attract most of the scores from their concept tests. 
For others there were actually no concept scores at the top of 
the value pattern, but many at lower points in the pattern. 
This reflects the fact that, while most students commented in 
terms of their highest values, some of them made comments 
which did not relate to their high values at all. 

The final score was determined as follows. The plus and 
minus scores opposite each value were combined algebraically. 
Scores opposite the first value were weighted by five, those op- 
posite the second value by four, those opposite the third value 
by three, those opposite the fourth value by two, and those 
opposite the fifth value by one. The five weighted scores were 
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then added algebraically. In order to keep away from negative 
numbers, 100 was added to each final score. Thus a score of 
100 indicated that no comments had been made which con- 
cerned the first five values in the test, or that the plus and 
minus scores equalled each other and thus cancelled out. A 
scoic below ICO indicated a dominance of negative scores, and a 
score over 100 a dominance of positive scores. 

There were then two variables, independently developed. 
The first was a score representing the student’s attitude toward 
the proposition to abolish fraternities and sororities. The 
second was a score which represented the net balance between 
benefits and detriments believed by the student to be exerted 
upon him by a fraternity or sorority, and limited to those effects 
which were related to his highest values. One score is a re- 
action to a proposition, often described in the literature as a 
“degree of affect toward or against” the proposition, The 
other score represents conceptual content and its relationship 
to cherished values, or generalized conditions of living. 

Data 

The correlation between these two sets of variables was 
— .804, the negative sign being due to the fact that favorable 
attitude is shown by a low score, rather than a high one. In 
view of the generally accepted point of view that knowledge is 
not significantly related to attitudes (14), this is a striking result, 
although It is in conformity with the thesis that values are 
directive factors in behavior, and that attitudes are an aspect 
of behavior, and not causative factors. 

The next question in the course of the study was whether a 
change in concepts would result in a change in attitude, and 
whether the change in attitude could be predicted from the 
change in concepts. During the three months following the 
administration of the tests, the students were supplied now 
and then with abstracted material from the literature on fra- 
ternities and sororities (i, 3, 4, 6, 7, 8) 9, ^ 

with an occasional opportunity to discuss them. Althougi 
most of the literature is favorable on a number of points, no 
position was taken by the class leader. In the meantime sonie 
of the students were having experiences of various kinds with 
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fraternities and sororities, and their concepts were being 
affected by these experiences. 

At the end of the term the attitude tests and the concept 
tests were again administered. It was assumed on the basis 
of other studies (ao) that the value patterns W'cre not likely 
to have changed in such a short time. Seventy-nine students 
returned usable responses on thi.s testing. 'Phe results of the 
final testing were handled in two ways. First a correlation was 
calculated, and turned out to be --.73, which is lower than the 
first, but still very substantial. Second, the changes In scores 
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I’lO. I. Reltttioiwliip Between Chatigci in Score*; from ii Conccpt-V.alue Test and from 

an Attitude Tc<.t 


were plotted graphically to reveal what relationships there 
were between such changes. Figure I contains the graph. 

The first and fourth quadrants should contain all of the 
plotted points ij an increase in the concept-value score always 
accompanied a change toward a more favorable attitude. Any 
reversals of this relationship would appear in the second and 
third quadrants. When all changes, no matter how small, 
were taken into account, 46 of the points are plotted in the first 
and fourth quadrants, and 1 8 in the second and tlilrd quadrants. 
These 64 students had changes in both scores. The other 15 
students changed only one score, and were therefore plotted 



VALUES, CONCEPTS, AND ATTITUDES 


655 

on one of the lines between the quadrants. This provides 
strong evidence that changes in concepts tend to produce 
harmoniou.s changes in attitudes. A question arises, however, 
as to what constitutes a significant change in scores. Since 
attitude scores were multiplied by ten to escape decimals, a 
change of three is really equal to a change of only .3 on the 
actual attitude scale, which varies for our students from 8.6 
to 1.4, with a standard error of ,175. A change of three points 
on the concept- value score may be judged in relation to the 
spread which goes from 61 to 153, with a standard error of 1,75. 
If a change of three points were considered to be insignificant, 
it would mean that 36 of the students faded to change one 
score by a significant amount. Of the remaining 43, 35 (or 81 
per cent) were shown to be in quadrants one and four, and 8 (or 
19 per cent) in quadrants two and three. 

What may prove to be a significant lead in the relationship be- 
tween concepts and attitudes is to be found in an examination 
of individual students’ responses There is a marked tendency 
for those with relatively neutral attitude scores to show no 
identifiable conceptual content about the subject. For ex- 
ample, contrast this quotation with the one quoted earlier as 
an answer to tlie same question’ 

Would nor affect me in any way that I can po.ssibly see I am 
an iiidepeiulent so my life here is not connected at all with fia- 
terniries except in tlie indirect way that I know some men in 
houses and their abolition ceitainly wouldn’t affect this in any 
way. 

Again from the last question on the same student’s sheet; 

If they were aboli.sbed I think that the groups of men and 
women would still be living m these houses, even if taken ovei 
by the Univcr.sity, and would still form social groups have 
functions together — a.s foi example the girls dorms do now 
open houses, etc. Of course probably these relationships 
woukl not nearly be so closely knit as now but otherwise I 
tliink life would go on much the same, Personally I can see no 
point in abolishing them. If a person don’t like them he 
doesn’t have to join and if he does like them he should not have 
the freedom of becoming part of one taken away from him 

This boy’s attitude score was 64, which is neutral, and his 
concept-value score was 99, which means there was i weighted 
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negative point found on his concept check-list. It is suggestive 
of the fact that many individuals who show neutral attitudes 
toward objects nr conditions do so because they have had no 
meaningful experiences with the object, and particularly 
acquired no meaning related to their most important values. There 
were several responses similar to this example, but few re- 
sponses in which much ctmccptual content was accompanied 
by a neutral attitude. In fact, the generalization seems war- 
ranted that extreme attitude scores occur in this study only 
when the person’s highest values are involved In the proposi- 
tion, and when there is a clear margin between negative and 
positive concept expressions- 

In the case of two students, opportunity was accidentally 
afforded to attempt prediction of attitudes. Both of the 
students misinterpreted the instructions on the attitude test, 
and recorded their attitude towani fraternities rather than their 
attitude toward the abolition of fraternities. Suspicion that 
this had occurred arose when the twtj final sets of variables 
were being studied, because the scores for these two students 
were so greatly at variance with all the others. The experi- 
menters, in discussing the two pairs of .scores, decided to ask the 
students whether they had misinterpreted the instructions, and 
if so, whether they would complete the attitude tc.st again in the 
proper manner. Both admittetl they had misunderstood, and 
both took the test again. Prior to asking them about the 
matter, an attempt was made to estimate from their concept- 
value scores what the true attitude scores would be, by using 
the lists of paired variables of the other students as a rough 
eq[uation table. In the case of one, the first attitude score 
was 3,3, and on the basis of his concept-value score it was 
estimated that his true attitude score should be between 8.0 
and 8.3. On retest it turned out to be 7.9. In the other case, 
the first score was 8.4. The estimate indicated he should fall 
between 6.0 and 6.6, His retest score was 6.0. If such a 
study were to be repeated, it would be interesting to set up the 
relationships between attitude scores and concept-value scores 
for only half of the group at first; then from the concept-value 
scores of the remainder, attempt to predict the attitude scores 
before the attitude tests were scored. It seems probable that 
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in any fairly homogeneous group (speaking intellectually and 
socially) a scale could be developed from which a concept-value 
score could be used to estimate an attitude for other persons of 
similar background. 

Conclusions 

One’s attitutle toward a specific object or condition in a 
specific .situation seems to be a function of the way one con- 
ceives that object from the standpoint of its effect on one’s 
most cherished values. This means that while concepts alone 
cannot be shown to correlate highly with attitudes, when con- 
cepts are combined with subjective judgments as to the ability 
of the concept referent to help the individual achieve the 
things he wants, the basis exists for explaining attitudinal and 
emotional reactions. If, in the judgment of the individual, a 
given object has no effect on his high values, he will exhibit a 
neutral attitude toward it. If he conceives it to be destruc- 
tive of his high values he will exhibit a negative attitude to- 
ward it, and vice versa, 

Attitudes will change when either one of the two basic factors 
change. If the value pattern is altered, it follows that certain 
objects which might have promoted formerly cherished values, 
but which do not promote presently cherished values, will no 
longer evoke the pleasant attitudes they formerly evoked. 
Also, if the concept of a given object or condition is changed, 
so that its potential effect on certain values is believed to be 
altered, the atti tude will reflect that conceptual change. Unless 
the nature of the change in values or in concepts is known, the 
change in attitude will be relatively unexplainable. 

Since value patterns appear to be fairly resistant to change, 
it seems likely that most changes produced in attitudes wi 
be brought about by making changes in the concept of the 
object toward which the attitude is expressed. This emphasizes 
the role of education in producing changes in behavior, but 
offers a realistic explanation for the fact that educationa 
practices which do not really change concepts and which do 
not take into account value patterns, are futile. 

One of the most needed psychometric devices, and one which 
is almost nonexistent at the present time, is a test or a set o 
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tests or techniques for ineasurinu functional concepts. It is 
suspected that these devices will not need to he as .subtle and 
indirect as has been generally supposed, and that the futility 
of direct tc.st.s of iilcas has l)een caused by failure to take into 
account all of the directive factor.s in behavirjr. An individual 
can probably give a fairly valiii verbal description of his mo- 
tives, especially his concepts of means anti processes. When 
his values are kmtwn, these verbally expresscil niean.s and pro- 
cess concepts are likely to pnivc most enlightening us to the 
reasons for his behavior. 
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MEASUREMENT IN RURAL HOUSING— A PROGRESS 

REPORT 


CHARLES L. DURRANCE, JR. 

University of Florida 

What can scliools do to improve housing in a community? 
How can schools help people to use the scientific knowledge that 
is available? Is it the responsibility of the school to provide a 
functional program, that will include activities in all grades to 
help pupils repair and improve their homes, beautify the 
grounds, and eliminate health hazards? 

Florida Project 

The Project in Applied Economics at the University of 
Florida is vitally interested in these questions. 

From grants-in-aid from the Alfred P. Sloan Foundation, 
the Project, established in 1940, is a part of a nationwide pro- 
gram to improve the level of living. It operates under the 
direction of a committee composed of representatives from the 
College of Education, the Administration of the University, 
and the State Department of Education. It has as its purpose 
the development of housing materials and activities for all 
grades, 

The Project attempts to find out whether or not the houses 
of all boys and girls will be improved as a result of the instruc- 
tional program in housing. Constant checks are made to see 
if the classroom activities are extending into the homes. 

The Florida Project works with three assisting schools, 
selected because they are located in typical rural, nontourist 
communities and because the faculties were interested in 
experimenting with new curriculum materials to improve living 
in the communi ties . These schools have agreed to center atten- 
tion on experiences designed to improve housing. Paired with 
these assisting schools are three control schools, which have 
agreed to cooperate in a measurement program but not to use 
the Project materials. 
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Getting Started 

Before the Project could make mucli headway, it was neces- 
sary to develop a housing inventory to detennine what were the 
greatest housing needs of the assisting and control communities 
and which needs the schools should use for developing a pro- 
gram of housing education. This inventory included 96 items, 
which may be classified under the following general groupings: 
(i) size of house and arrangement; (e) roof, frame, foundation, 
steps; (3) interior— walls, floors, ceiling; (4) sleeping space; 
(5) kitchen - space and facilities; (6) ownership — valuation and 
attitudes; (7) yard and building site; (H) heating facilities and 
fire hazards; (9) lighting— natural and artificial; (10) exterior 
walls; (ii) doors and windows; (12) water supply and sanita- 
tion; (13) age of house. 

A staff of workers used thi.s inventory to survey housing 
conditions, Every house in the assisting and control com- 
munities was photographed and conditions of the houses were 
indicated. This information is now serving as a basis for the 
evaluation of the liousing instruction program to see whether 
conditions have been improved. 

Results of the Semi-Tear Study 

Significant results are reported on only two classes of homes; 
(l) The same house, same occupant both years and (2) the 
same house surveyed in 1940 and 1947, even though the occu- 
pant changed. Some of the more significant findings are here 
presented. 

An examination of the summary of results indicates that 
in 24 selected items the experimental communities made the 
greatest improvement in housing conditions. In six items the 
control communities made the greatest improvement. In ten 
items there was no significant difference between the two 
groups, 

The experimental communities made more improvements 
than the control communities in the elimination of fire and 
health hazards, especially in improving the water supply, 
eliminating the unsanitary surface privy, wiring for electricity, 
substituting adequate heating facilities, using some means of 
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refrigeration, making repairs on the roof, cleaning of yards 
littered with garbage, screening windows and doors, and build- 
ing adequate chimneys and flues. 

The control communities made the greatest improvement in 
termite proofing and in the addition of village garbage dis- 
posals. It will also be noted that there were fewer homes in 
the control communities with screens and steps in worse con- 
dition in 1947 than there were in 1940, 

There was no significant difference between the experi- 
mental and control communities in the number of new houses 
built since 1940. A very high per cent of the houses in both 
groups still liave no other means of heating than the open fire- 
place. 

The influence of the school program on the changes in the 
community has not been determined. Changes in the com- 
munity were not as great as might be expected, partly because 
the total school program was not involved. Not one of the 
three experimental schools had the same principal for all of 
the seven-year period. There were five different principals 
in one school, four in another, and three in the third school. 
The turnover of teachers in the three schools followed the same 
pattern. In one school the average yearly turnover of ele- 
mentary teachers was ai per cent; in the second school it was 
75 per cent; and in the third school it was 46 per cent. In 
1946-1947 all of the elementary teachers in one school were 
new. In one of the three high schools, where 38 teachers were 
employed during the seven-year period, 26 of the 38 teachers 
taught only one year. 

Findings of Preliminary Housing Survey in 

In defining the term “community” a different interpretation 
was used from the one generally accepted. “For the purposes 
of this study, a community is defined as consisting of all those 
families, and only those families, which send at least one child 
to a specific school being studied.”^ 

There were 713 houses surveyed in the six rural Florida com- 
munities, with these significant findings: 

1 Mosier, Charles I. "Measurement in Rural Housing— A Preliminary Report, 
Educational and Psychological Measurement, 11(1941), 139-1J2. 
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Wafer supply— 6i per cent had only outside hand pumps or 
wells 

Toilet facilities - 16 per cetit had no Ujilet facilities; 70 per 
cent had no better than an open surface privy 
Lighting— -72 per cent had no electricity 
Termite damage— 24 per cent showed evidence of damage 
Termite proofing— only 2 per cent of homes were termite- 
proofed 

Sink— 80 per cent had no kitchen sink whatever 
Refrigeration— 52 per cent had no refrigeration 
Garbage disposal- 15 per cent had yards littered with garbage 
and refuse 

Screens-— 4I per cent had all outside openings screened 
Cabinet space- -15 per cent had no pantry or storage space in 
kitchen 

Chimney and flues— 63 per cent constituted a fire hazard 
Shrubbery — 37 per cent had no shrubs around the house 
Roof conditions— 47 per cent needed some repair 

Dr. Mosicr Indicates that the differences between the exper- 
imental and control groups were small, but that the control 
group showed a slight superiority. 

Signijlcant Changes in Houses from /g^o~ig^y 

From October of 1946 to November of 1947 a staff of workers 
gathered data for the second phase of the evaluation program 
of the University of Florida Project in Applied Economics. 

All homes in the three experimental communities and the 
three control communities (where there were children in school) 
were visited and conditions of the houses were indicated on the 
Questionnaire for the Partial Measurement of the Effectiveness of 
a School Program in Housing Instruction 
There were 823 homes surveyed in 1947— an increase of 108 
over 1940. These 823 homes were then divided into seven 
classifications: 

1. Same house, same occupant both ye.ars 

2. Same house, same occupant, but no children in school in 

W47 

3. Same family, different house 

4. Same house, different occupant 

5. Old house— not suiweyed m 1940 because no children in 

school, but family does have children in school in 1947 

6. New house (built since 1940 and no 1940 house available 

for comparison) 

7. House surveyed in 1940 but not in 1947 (with reason given) 
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For the tabulation of data, two tables were made to indicate 
changes made during the seven years. These two tables were: 
Table i—same house, same occupant both years (classifications 
I and a above) ; Table a — changes in same houses surveyed both 
years (classifications i, a, and 4 above). It was believed that 
information about classifications 3, 5, 6, or 7 would not give 
significant data. 

The comparison of the number of houses tabulated for these 
two tables follows; 


Town 

Same House, 

Same Occupaot 

Sojne Houses Sur- 
veyed 1940 and 1947 

Bardin 

14 


Ladyl.ind 

18 

13 

Siimmcriield 

S3 

75 

Melrose 

41 

66 

CKicRand 

114 

Itt 

Branford 

Ill 

Total Exircrimental Group 

181 

144 

Total Control Group 

170 

14J 


For purposes of simplification, the experimental communi- 
ties will hereafter be referred fo as Group “E”; the control 
communitie.s as Group “C.” 

Some of the significant findings are presented here (informa- 
tion obtained from Tables i and 2): 

fFater Supply , — Table i indicates that in the experimental 
communities (1940) lao homes had an outside hand pump and 
84 of the homes in the control group depended on the outside 
hand pump for water. By 1947 this decreased to 84 for the 
experimental group and to 64 for the control group. Thus in 
1947, 46.4 per cent of the homes in the experimental group and 
37.7 per cent of the homes In the control group still had nothing 
better than a hand pump. The percentage decrease, however, 
favored the experimental group 20 per cent to 12 per cent. In 
the experimental group the number of power pumps increased 
206 per cent during the seven-year period and 100 per cent for 
the control group. Table 2 indicates that fourteen homes in 
both groups changed from depending on a well or carrying water 
to the use of a power pump and tank. 

Toikl Facilities .— the experimental communities 
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TAin,K t 


Comparison oj Sdecud hems in Kame Houses and Same Occupants 


Rebuilt, 

Yes ... 

No 

Wftter Simply: 

Well 

Outside hand pump 

Power pump und tank 

Toilet Facilities: 

None 

Surface privy . .... 

Sanitary pit privy. . 

Flush toilet . .. 

Lighting: _ 

Old-fashioned lamp.s 

Electricity 

Heating Fnciiitic.s: 

None except cookstovc 

Fireplace 

I-Icatjng .stove 

Heating stove and fireplace. . , 

Kind of cookstovo' 

Small wood stove. . , 

T,argc wood range 

Electric 

Gas 

Kero.senc ... 

Is There a Sink? 

None 

Yes; no outside drain 

Outside drain and water .supply... . 

Termites: 

Extensive damage 

Obvious evidence, ._ 

No protection, no evidence. , , 
Termite proofing . ... 

Kind of Refrigeration: 

None 

Ice box, no ice 

Ice box, with ice 

Mcchanicni refrigerator 

Garbage Disposal: 

Yard littered 

Yard clean 

Covered cans . 

Village disposal 

Screens: 

No screens 

Some screens 

All good screens 


Tnlal 

’■E" 

Total 

"C” 

’to 

•47 

MO 

'47 



— 


S5 

.14 

55 

f >9 

124 

>47 

106 

lot 

7 

2 

20 

5 

120 

84 

84 

f )4 

3 '^ 

04 

48 

96 

20 

8 

27 

>4 

too 

77 

92 

81 

3 ' 

17 

8 

6 

25 

42 

25 

55 

07 

45 

114 

61 

(lit 

> 3.1 

42 

loo 

1 ) 

2 

2 

2 

n,i 

01 

125 

112 

ji 

f '7 

10 

19 

ri 

22 

12 

32 

75 

28 

fio 

38 

.1.T 

4 > 

62 

38 

0 

0 

1 

1.1 

2 

22 

5 

27 

,75 

04 

23 

53 

> 5.1 

123 

no 

94 

5 

3 

6 

21 

22 

54 

36 

55 

II 

2 

lO 

4 

2.1 

3.1 

22 

37 

142 

>37 

117 

111 

5 

0 

I 

18 

87 

43 

83 

52 

7 

4 

7 

9 

40 

58 

35 

33 

45 

76 

36 

74 

42 

7 

26 

>9 

>35 

102 

135 

126 

4 

n 

0 

2 

0 

0 

0 

>3 

4 I 

41 

57 

50 

51 


32 

39 

88 

116 

72 

9 > 
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TABLE 1 — Concluded 



Total “E” 

’40 ’^7 

Total ' 
^40 

“C” 

'47 

Water Supply: 





Very poor 

5 

0 

I 

0 


. ... 80 

48 


22 




Fair 

II 

3 

4 

16 

Good 

65 

91 

III 

138 

Cabinet Space; 





Completely absent 

4 

0 

3 

9 

Poor makethifta 

Ib 

10 

II 

18 

Inadequate. . ... 

.... 68 

1 23 

44 


Adequate-excellent 

gi 

48 

107 

85 

Chimney and Flues: 





Stove pipe 

8 ; 

26 

46 

44 

Poorly itLSulatcd 

14 

14 

20 


Well insulated. . . 

80 

137 

go 

86 


had eight more homes with just surface privies in 1940, they 
had four less than the control communities in 1947. Adequate 
toilet facilities (either sanitary, pit privy or flush toilet) were 
in 32.6 per cent of the experimental homes and 35.9 per cent of 
the control homes in 1947. However, 17 “E” and 13 “C” 
changed from no toilet in 1940 to a surface toilet in 1947; and 
30 “E” and 13 "C” changed from a surface privy to a sanitary 
pit privy. Unfortunately, four homes in the “E” group which 
had a surface privy in I940 had no toilet in 1947. 

There was a general decrease in the number of homes with 
no toilet facilities. Group "E” had a decrease of 11, with 8 
homes still without toilets. Group “C” had a decrease of 13, 
with 14 homes with no toilet facilities. 

Lighting. — Sixty-seven homes in Group “E” have installed 
electricity; 58 in Group "C.” If we look at the comparison of 
the same houses surveyed both years (Table a), 89 (36.5 P^t 
cent) of the homes in Group “E” have added electricity; 73 
(30 per cent) in Group “C.” Sixty-one homes in Group C 
still liave old-fashioned lamps; 45 homes in Group E. Two 
homes in Group “C” have even changed from electricity to old- 
fashioned lamps. 

Termite Damage . — Damage from termites remained the same 
in both years in the homes of Group “E” and increased from 
!2o to 2.4 per cent in Group “C.” With reference to termite 
proofing, the increase was greater in the control group 17 as 
compared to four. 



TABLIi 1 

Signijicaiil Changes tii Houses {Comparison of Same Houses Siiri'eyed tii and 


Rebuilt or Remodeled. 


Tout “r," 

Tolal "C" 

Yes, 


JO 

99 

No 


• ■ 194 

146 

Water Supi'ly 

Well to porch pump 


0 

a 

Hand pump or carried to power pump . 


74 

71 

From well or carried to hand pump. ...... 


9 

5 

Toilet Ittcilities. 

None to llusli toilet ... 

. * . 

a 

3 

No toilet to surface privy . . . 

. . . . 

. 17 

13 

No toilet to pit privy 


7 

3 

Surface privy to pit privy 


30 

13 

Surface privy to inside toilet 


12 L 

18 

Pit privy to inMde toilet 


8 

9 

Surlace privy to no toilet 


... 4 

0 

Pit pi ivy to surface privy 


8 

s 


LiRlumg: 

Electricity added 

f)ld-fasliioiied lamps to improved. . 
Electricity to old-lashioned lamps . 
Old-fiusliloncd l.imp.s to candles. . . . 


89 

6 

o 

o 


73 

4 

a 

I 


Termites: 

No protection to obvious evidence and damage 30 31 

Damage from termites to no evidence .. 34 15 

Termite proofing added 7 20 

Chimncy.s and Flues; 

Stove pipe to brick insulated 71 8 

Brick insulated to poorly insulated 3 J 

Brick insulated to stove pipe 6 12 

Brick poorly insulated to insulated 16 9 

Stove pipe to poorly insulated 8 5 

Stove pipe to none . 3 3 

Some insulation to none J 9 

Kind of Cookstove; 

Wood stove or range to kerosene 106 44 

Electric stove added 10 12 

Gas .stove added . . . . 20 27 

Small wood stove to large wood range .... .10 6 

Kerosene to wood .stove 2 i 

Electricity to kerosene o i 

Is There a Sink? 

No sink to outside drain and water supply 29 23 

No sink to water .supply, no outside dram a 20 

Outside drain to no .sink. 2 4 

No outside drain to outside drain 5 4 

Ilcfrigeration: 

No reftigciator to ice box J3 

No refrigerator to mechanical refrigerator 17 23 

Ice box to mechanical refrigerator 22 eo 

Mechanical refrigerator to ice box 2 i 

Ice box or mechanical refrigerator to none 17 9 

lee box no ice, to ice box with ice a 3 
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TABLE 2 — Cdniinutd 


Total "E’* Total “C" 

Garbage Disposal* 

Yard littered to yard clean 
Yard clean to littered, . 

Covered garbage cans added 
Village dit>l>osal added . 


55 11 

13 9 

7 4 

O 22 


Screens* 

No screens to all good screens 

... 16 

7 

No screens to some gtxxl screens 

.... 9 

6 

Poor screens to sonic good screens . ... 

a6 

8 

Some screens to iHior or no .screens 

27 

18 

(worse than In 1940) 

Some good screens to all good screens 

9 

3 

Steps. 

I'Tom good to fair. ... 

11 

31 

From poor to fair ......... 

13 

10 

From good to poor 

. . II 

I 

From lair to goo<l. , 

34 

14 

From fair to poor 

IS 

4 

Stcjis added — from no steps to poor 

• 7 

0 

Steps added-— from poor to good 

21 

5 

Yard: 

From clean to littered . ... 

14 

12 

Lawn added . 

• • • • 35 

19 

Littered to clean 

13 

2 

Swept or raked to clean, no gra.ss 

1 

9 

From lawn to no lawn 

.... IS 

9 

From grass cut to littered . . . . 

4 

I 

From clean to raked, but no gra.ss 

5 

0 


Shrubs: 


Inadequate to none 

35 

21 

Ademiatc to Inadequate or none 

. .. 9 

7 

Shnios added . . , ... . . . . 

31 

26 

Well-placed, nor enough to inadequate 

. II 

2 

Inadequate poorly placed to well-placed. 

13 

3 

Fini.sh of Floors: 

Linoleum added 

, . 82 

46 

Added living room rug 

33 

6 

Condition.s wor.se than in 194a . . . .... 

10 

19 

Other improvements made 

9 

X 

Roof Conditions; 

Repairs made on roof. 

8S 

38 

Roof deteriorated since 1940. . . . 

... . 47 

39 

Kitchen Arrangements; 

Improvements made. ... 

29 

13 

1947 conditions wor.se than in 1940. . . . 

123 

78 

Cabinets' 

Improvements made , . . , . . . 

47 

22 

1947 condition-S worse than in 1940 


56 

Condition of Water Supply: 

Lrom good to fair 


7 


23 

0 

From poor to fair 

2 

0 

From poor to good 


20 

From fair to poor 

7 

0 

From fair to good 


2 
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Healing Facilities . — Both groups have added heating stoves 
or circulating heaters (an increase of 67 in Group “E” and 10 
in Group “C”). However, there are still a large number of 
homes depending entirely on fireplaces for heating facilities 
(91 in Group "E” and lin in Group “C”). Thus, 50 per cent 
of the homes in the experimental communities and 66 per cent 
of the homes in the control communities still use only fire- 
places for heating. Group “E” made more improvement in 
this than Group “C” (a decrease of la per cent in Group “E” 
and 8 per cent in Group “C”). There are still four homes in 
the six communities which have no heating facilities except a 
cooks tove. 

Kind of Cookstove . — ^Tablc i reveals that there has been a 
great shift from the small wood stove and wood range to the 
use of kerosene for cooking. In 1940, 108 homes (60 per cent) 
in Group “E” and 131 homes (77 per cent) in Group "C” de- 
pended on wood. By 1947 this had decreased to 69 homes 
(38 per cent) in Group “E” and 76 homes (45 per cent) in 
Group "C.” Between 1940 and 1947 Group “E” has added 
nine electric stoves and Group “C” la. Both groups are prac- 
tically equal in the addition of gas (butane) stoves: Group “E” 
increased from two to la and Group “C” from five to 

Table 1 indicates the same change from wood stoves to kero- 
sene when we consider the same houses surveyed both years. 
In the experimental communities 106 of the 244 families 
changed from wood to kerosene for fuel, and 44 of the 245 
families in the control communities made this change. In the 
addition of gas and electric stoves the increase in both groups 
parallels that revealed in Table 1. People who used kerosene 
in 1940 continued to use it in 1947) for only three switched from 
kerosene to wood (two in Group “E” and one in Group “C”). 

Is Fhere a Sinkf . — ^There is still a high percentage of homes 
without a kitchen sink. Of the homes surveyed in 1940, 84.5 
per cent of those in Group “E” and 70 per cent of the homes in 
Group “C” had no sink. By 1947, 68 per cent of Group “E” 
and 55 per cent of Group “C” still had no sink. Thus both 
groups made almost identical improvement (16.5 per cent for 
Group “E" and 15 per cent for Group "C”). The experimen- 
tal group, however, made more improvement in the addition 
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of a sink with outside drain and water supply: 32 homes in 
Group “E” and 19 homes in Group “C.” 

Table a reveals these significant changes; (i) 29 homes in 
Group “E” and 23 homes in Group “C” which had no sink in 
I940 had added a sink and water supply by 1947 , (2) four homes 
in Group “C” and two homes in Group “E” had a sink in 1940 
but none in 1947. 

Refrigeration . — Table l shows that in 1940 Group “E” had 
87 or 48 per cent of the homes without refrigeration; Group 
"C”, 83 homes, or 49 per cent. By 1947 this number had de- 
creased to 43 or 23.8 per cent in Group “E” and to 52 or 31 per 
cent in Group "C.” Thus Group “E” made 24 per cent im- 
provement, while Group “C” made only 18 per cent improve- 
ment. Group “E” added 31 mechanical refrigerators and 
Group “C” added 38. 

Table 2 indicates the substitution of mechanical refrigera- 
tors for ice boxes, probably the result of the introduction of 
Rural Electrification Administration lines into the com- 
munities. In many homes the survey revealed electrical con- 
veniences, such as refrigerators, stoves, and washing machines, 
where there was no evidence of preservation of the house in 
such matters as painting, roofing, or protection against pr- 
mites. If we look at the addition of some kind of refrigeration, 
26 more homes in Group “E” than in Group C made this 
change. This is evidenced by the fact that Group E added 
53 ice boxes, while Group “C” added only 21 . Unfortunately, 
17 homes in Group *'E” and 9 homes in Group C having 
refrigeration in 1940, had none in 1947- 
There were 45 homes in Group “E” and 36 homes in Group 
“C” with mechanical refrigeration in 1940. Of this group of 
81 only three families changed in 1947 to the use of an ice box. 

Garbage Disposal . — ^There was a great decrease in the number 
of homes with yards littered with rubbish and garbage. The 
greatest improvement was made in the experimental communi- 
ties. The decrease in littered yards here was 35 (from 42 to 7), 
while the decrease was 7 (from 26 to 19) in the control com- 
munities. Most of the families either burned or buried or fed 
garbage to the animals. Thus there were very few covered 
garbage cans. One significant change to be noted during the 
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7-year period is that tlie town of Branford (Group “C”) made 
available village garbage disposal and that 1 3 families (same 
house in 1940) used this method of garbage disposal, 

Table 1 shows that Group “E” also made the greatest im- 
provement in cleaning the yards — 55 as compared to 17 for 
Group “C.” 

Screens. —y tty little improvement seems to luive been made 
in decreasing the number of homes with no screens. The num- 
ber of homes without screens remaineil the same in Group “E” 
(41), while it decreased seven for Group "C” (57 to 50). How- 
ever, if we look at the number of homes with all good screens 
the number increased a8 in Group “E” and 19 in Group “C." 
Looking at Table 1, we see that 16 homes in Group “E” with- 
out screens in 1940 added all good screens. Only seven homes 
in Group “C” made this improvement. On the other hand, 
if we compare the condition of screens in tlic liomes for both 
years, 2,7 homes in Group “K” and 18 homes in Group “C” 
had screens that were in worse condition in 1947 than in 1940. 

Cabinet Space . — Here the experimental communities had 
more improvement tlian the control communities. In 1940, 
four homes in Group "E” and three homes in Group "C” had 
no cabinet space whatsoever. In 1947 all homes in Group “E” 
had some cabinet space, while the number witliout cabinets 
actually Increased in Group "C” from three to nine. The same 
is true of the homes with "poor makeshift" cabinets. In 
Group "E" the nunrber decreased from 16 to 10, while in Group 
"C” it increased from ii to 18. 

Both groups seemed to do little about providing adequate 
cabinet space. In fact, tliere were more homes with inadequate 
cabinet space in 1947 than in 194O. Table 2 reveals that while 
in Group “E” the cabinet space conditions were worse in 1947 
than in Group “C," more improvements were made than in 
Group "C” (47 as compared with in). 

Chimney and Plues . — In 1940, 85 (47 per cent) of the homes 
in Group "E" and 46 (27 per cent) of the homes in Group "C" 
had flues that were definitely a fire hazard. The greatest im- 
provement in this respect during tlie 7-year period was made in 
Group "E” — a decrease to only 26 (14 per cent) in 1947 as 
compared to 44 for Group "C" (ai per cent). Group "E" had 
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fewer well-insulated chimneys in 1940, but in 1947 it had a 
greater number of well-insulated chimneys than did Group “C” 
—an increase of 57 well-insulated chimneys for Group “E” and 
a decrease of four for the control group. 

1 able 2 gives a clearer picture of this trend 

Signifirant Clmiijie (1940-1D17) Group "E" Group “C” 

From stove pipe to brick insulated 71 8 

From poorly insulated to well insulated 16 9 

From .stove pipe to poorly insulated . 8 5 


Thus we see that 95 homes in Group “E” made an effort to 
eliminate fire hazards, while only 12 homes in the control group 
accomplished this result. It will be noted also in Table 2 
that 12 homes in Group “C” with brick insulation in 1940 
reverted to a stove pipe m 1940; this happened to only six 
homes in the experimental group. 

Steps . — Improvements were made in 75 homes in Group “E” 
and only 29 homes in Group “C.” On the other hand, 111 1947 
conditions were worse in 47 of the Group "E" homes and 36 of 
the Group “C” homes than they were in 1940. 

Miscellaneous Changes . — Lawns were added to 35 homes in 
Group “E” and only ig in Group “C.” 

Addition of shrubbery was almost equal in both groups — 
31 for Group “E” and 26 for Group “C.” 

Two changes stand out in the finish of the floors: (i) addi- 
tion of linoleum, (2) addition of living room rug. In each of 
these the experimental group had the advantage (see chart be- 
low). 


SiKnificant Changes (1940-1947) 
Lincoleum added. 

Living room rug added 
Conditions worse than in 1940 . 
Other improvements made . 


Group “E" 

Group “a' 

. . 8a 

46 

33 

6 

. JO 

19 

9 

I 


It will also be noted that conditions in 1947 were worse in 
almost twice as many homes in Group “C” as in Group “E.” 

Almost the same evidence holds true for repairs on the roof. 
Eighty-five homes in Group “E” and 38 in Group “C” made 
repairs on the roof in the period between 1940 and 1947- How- 
ever, in 39 homes of Group "C” and 47 homes of Group “E” 
the roof conditions deteriorated during the 7-year period. 

So far as making improvements in the kitchen arrangement 
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IS concerned, not much can be said. Only 29 in Group "E” 
and 13 in Group "C” made any improvement along this line. 

The tables indicate that mucli progress has been made in 
the improvement of housing conditions in the six communities 
surveyed in 1940 and 1947. The table below helps us to see 
(l) selected items in which the experimental group excelled; 
(a) selected items in which the control group excelled, (3) se- 
lected items in which there was no appreciable difference. 

Items in which experimental group made greatest improvement 


Group “E” 

Decrease in per cent of homes depending 

Group “C” 

on outside hand pump ; . . 

Increase in per cent of homes adding 

oo 

12 

power pump and tank _ . . 

Increase in number of homes changing 
from surface privy to sanitary pit 

ao 6 

100 

privy.. 

Increase in per cent of homes adding elec- 

30 

13 

triclty 

Number of homes still depending on old- 

37 

30 

fashioned lamps 

Increase in per cent of homes damaged 

45 

61 

from termites • ' 

Addition of circulating heaters or heating 

.006 

.04 

stoves 

Increase in number of homes substituting 

67 

10 

kerosene for wood stove for cooking . . . 
Number of homes adding kitchen sink 

106 

44 

with outside drain and water supply. . 
Decrease in per cent of home.s without re- 

3 ^ 

19 

frigeration 

Nurnber of homes adding some kind of re- 

24 

18 

frigeration 

Nurnber of homes making improvements 

70 

44 

in kitchen arrangement 


13 

Number of homes making repairs on roof 
Decrease in number of homes with yards 

85 

38 

littered with garbage ._ 

Increase in number of homes with all 

35 

7 

good screens ^ 

Number of homes with all good screens 

28 

19 

in 1947 but with no screens in 1940. . . 
Decrease in number of homes with no 

16 

7 

kitchen cabinet space 

4 

creased 
3 to 9) 
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Number of homes making some improve- 
ment in cabinet space- . 47 22 

Number of ivomes eliminating fire haz- 
ards m flues , . , 22 

Number of homes changing from stove 

pipe to well-insulated chimney 71 8 

Number of homes making improvements 

insteps. 7^ 29 

Number of homes adding lawns 35 I9 

Number of homes adding linoleum to un- 
finished floors 82 46 

Number of homes adding living room rug 33 6 

I/ems in which control group made greatest improvement 
Number of homes adding termite proof- 
ing- ; 17 4 

Decrease in per cent of homes depending 

on wood stove for cooking 22 32 

Number of homes with refrigeration in 

ipao but with no refrigeration in 1947 17 9 

Numner of homes adding village disposal 

for garbage o 13 

Number of homes with screens in worse 

condition in 1947 than in 19,^0. ... 27 18 

Number of homes with steps m worse 

condition in 1947 than in 1940 47 36 

Items in which there was no significant di^erence between the two groups 
Number of families building new houses 

since 1 940 69 58 

Decrease in per cent of homes with no 

toilet facilities ... 7 8 

Per cent of homes with adequate toilet 

facilities 33 3^ 

Number of homes still depending on fire- 
place as only means of heating house 91 1 12 

Number of homes with no heating facili- 
ties except cookstoye. .... 2 2 

Number of homes adding electric stoves. 9 12 

Number of homes adding gas stoves . . 20 22 

Number of homes substituting wood 

stoves for kerosene in cooking. 2 i 

Decrease in per cent of homes with no 

kitchen sink in 1947. 17 

Number of homes adding mechanical 
refrigerators 3^ 


Implications Arising from this Study 

To what extent the school influenced these changes recorded 
in this survey information is not available. It must be as- 
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sumcd, however, tiiat in some instances where the chantrcs were 
much greater in the experimental coninuinities than in the 
control communities, education must have had some influence 
on these changes. 

It must be pointed out also that some change.s were not as 
significant in the experimental gruujvs as might be expected be- 
cause of the rapid turnover of principals and teachers. A real 
program in housing instruction was not adhered to, and the in- 
formation was imparted luit as a total school program hut in 
most cases in individual classrooms, I'eachers changed so fre- 
quently that by the time a teacher became familiar with the 
program she moved Co another area. This necessitatetl begin- 
ning again working to interest the new teacher who had taken 
her place. It is believed that if the experimental schools had 
undertaken the project wholeheartedly, in a total school pro- 
gram directed by an energetic, community-minded principal, 
the significant changes would he much more in evidence. 

Many of the changes came as a result of the introduction of 
Rural Klectrificatinn Administration into the communities. 
Other improvements came from high wages during the war 
years and the desire to have the comforts of life. 

This all points up the necessity for all community agencies 
to work together for raising the economic level of living in the 
community, It indicates the need also for teacher-training in- 
stitutions to prepare teachers to select their instructional mater- 
ial and to provide activities so that boys and girls will he able to 
understand and to meet their basic economic needs. Wlien 
teachers with this kind of training take their place in the 
schools, more schools will have as an integral part of their pro- 
gram activities for the improvement of living. Communities 
will then secure more adequate housing through education. 



INTI'.LLIGlsNCR TEST RESULTS OBTAINED FROM A 
SPECIFIC TYPE OF ARMY A.W.O.L. 


JF.RRY H. CLARK 

University of California, Santa Barbaia College 

At a Center which processed soldiers who had gone A.WD.L. 
from a unit prior to its shipment overseas, loo randomly 
selected literate trainees were administered four verbal sub- 
tests of the IFechskr Mental Ability Scale, Form B. It is 
pointed out that these trainees had committed a serious offense 
in terms of the effect on the war effort— they had deserted their 
organizations at the time when they were most needed For 
this reason, this offense is a specific type of A.W.O.L. and can 
be viewed as a very serious infraction of Army discipline. The 
following information concerning the loo trainees comprising 
the experimental group in this study is submitted: mean age, 
24.72 years; mean years of school completed, 9.19; mean weekly 
wage received prior to induction, $41.00; and mean number of 
weeks of Army service, 115. 

'I'lie Mental Ability Scale, Form B, was developed by Wechsler 
for clinical use in the Army, and was one of the authorized 
Army tests. Four of the verbal sub-tests (Information, Arith- 
metic, Comprehcn.sion, and Similarities) were orally admin- 
istered in order to obtain a measure of the mental ability of 
these trainees. The distribution of standard scores based on 
these four sub-tests is presented in Table i. The range of this 
distribution is 55-150, the mean standard score is 87.10, 
standard deviation, 18.20 A standard score of one hundred 
would be the strictly ‘'normal” score. Seventy-six per cent 
obtained scores below this level 

Tliese intelligence test scores may also be interpreted in terms 
of the I(^. b'or this group of 100 trainees, Table 2 presents the 
distribution of IQ’s. The range of this distribution is 7 i-i 35 j 
the mean is 92.65, the standard deviation is ii 95. These 
IQ scores, presenting in another fashion the scores obtained on 
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the four verbal sub-tests, alsf> reveal a skewness in the lower end 
of the distribution. Only 29 of the trainees have IQ’s of 100 
or above. The division of test scores according to Wcchsler’s 
categories (2) was tabulated as shown in Table 3, 

This table reveals tluit there are gross differences in the 
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classification levels between the percentages expected accord- 
ing to Wechsler (in a normal distribution) and on the percent- 
ages obtained from a tabulation of the one hundred scores 
obtained in the Processing Center. Of the 100 cases, 25 
have scored above the “normal” bracket; in actuality, only 
eight are so classified. Again, the expectancy below the "nor- 
mal” bracket would have been 25; actually, 48 scored in this 
range. The number of cases in the “dull normal” and “border- 
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line defective” categoiies is thus about twice the normal ex- 
pectancy. Although it IS noted that none of these 100 trainees 
would be classified in the “defective” bracket, this may prob- 
ably be accounted for in terms of the selection of the group 
which specified fourth-grade literacy in order that the MMPI 
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might be administered. From an inspection of the mean score, 
the standard deviation, and the classification levels in the 
above table, it is seen that this group is significantly lower in 
intelligence than the standardizing population used by Weehs- 
ler. The distribution of the scores of the 100 trainees on these 
four sub-tests is presented in Table 4. 
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It is seen that the mean score obtained on the Infotmation. 
sub-test is 8,82; twenty-two of the group scored above 10 and 68 
below 10. On the Arithmetic sub-test the mean is 8 87, with 
22 scoring above 10 and 63 below 10. The mean of the Com- 
prehension sub-test scores is 8.16, sixteen obtained a standard 
score above 10 and 71 below 10. On the Similarities the mean 
is 8.73; eighteen scored above 10 and 70 below 10. By in- 
spection, it appears that the distribution of the Comprehension 
sub-test scores is the only one which might be significantly 
different from the distributions of the other sub-tests. For 
this reason, the differences are presented in Table 5 in terms 
of the ci ideal ratio. 

It would seem, therefore, that the Comprehension scores are 
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significantly lower than those of Information, Arithmetic and 
Similarities. The critical ratio of 3.63 of the difference be- 
tween Information and Comprehension fulfills the demands for 
reliability; the critical ratios with respect to Arithmetic and 
Similarities are well above the 5 per cent level of confidence. 
Pattern analyses of the Wechsler are generally not based on 
the administration of only four sub-tests; however, this does 
not mean that these significant differences between sub-tests 
found above are meaningless or without interpretation. In 
discussing the Comprehension sub-test, Wechsler states that 
it might be termed a test of common sense and that success on 
this test apparently is dependent upon a certain degree of 
practical information and a “general ability to evaluate past 
experience” This “common sense” interpretation and 
“evaluation of past experience" might well apply to the group 
under discussion. It is not stretching the facts to say that 
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“good common sense” would pi’ovide a soldier with the knowl- 
edge that such behavior as “boat-jumping” (going A W 0 L 
to avoid overseas service) would really not solve his problem 
and that eventually he would have to suffer for the error of 
his ways. Moreover, the fact that 55 of these soldiers had been 
A.W O.L. before might indicate an inability to evaluate past 
expel ience properly (Admittedly, this fact might have other 
interpretations ) Twenty-eight admitted being A W.O.L. three 
times or more, including the present offense. 

This lower score, obtained on the Comprehension test, might 
also be better understood if the items of the sub-test are 
examined. Inspection reveals that many of the items might 
be based on the degree of “social intelligence,” as they have to 
do with fair play and one’s responsibility to his fellow man and 
to society. For example, consider the question, “What should 
you do if someone smaller than you started to pick a fight with 
you?” This question was number two on the list, and ap- 
parently should not be difficult except for the very dull, how- 
ever, it was surprising to see how many “o” or “i” responses 
were obtained in comparison to the number of “2” (highest 
scoie possible) responses. Many of these soldiers responded 
with “beat him up,” or “let him have it.” Many of the 
other questions having to do with social understanding also 
seemed to present great difficulty. Although it might be said 
that these prisoners violated Army rules and frequently re- 
peated the offense just because the error of their ways was never 
explained to them, there seems to be a possibility that they 
were actually deficient in social intelligence and that they were 
actually incapable of properly evaluating past experience 
This brings to mind one of the chief characteristics of the psy- 
chopath as delineated by Cleckley (i) — his inability to profit 
by experience, regardless of how chastening his experiences 
may be, 

Summary 

1. Four verbal sub-tests of the Wechsler Mental Ability 
Scale, Form B, were administered to 100 A W O.L. soldiers. 

2, The mean IQ obtained by these 100 A W 0 L ’s was 

92.65. number of those flailing in the “dull normal 
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and “borderline defective" categories was about twice the nor- 
mal expectancy. 

3 Comprehension sub-test scores were significantly lower 
than those of Information, Arithmetic and Similarities. A 
tentative explanation of this fact was offered: these trainees 
were deficient in social intelligence and in the ability to prop- 
erly evaluate past experience. 
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PREDICTIVE VALUES OF THE STANFORD SCT 
ENTIFIC AND THE ENGINEERING AND 
PHYSICAL SCIENCE APTITUDE TESTS 

H A COOPRIDER 

and 

H. R. LASLETT 
Oregon State College 

The measurement of special aptitudes is a phase of testing 
that is of unusual importance Measurements in this field are 
designed to offer bases for the predictions of probable success 
in particular fields of human endeavor. Such instruments can 
have extensive educational value in the control of school ad- 
missions and still more in counseling; but evidences of their 
predictive value for specific purposes must be available if such 
activities are to be valid. 

The problem of this study was the determination of the rela- 
tionships between scores on two special aptitude tests on the 
one hand and two scholastic aptitude tests on the other with 
grade-point averages which had already been earned in several 
subject-matter fields at the college level. The special apti- 
tude tests were the Stanford Scientific Aptitude P’est (8) and the 
Engineering and Physical Science Aptitude 'Test (a), The scho- 
lastic aptitude tests were the American Council on Education 
Psychological Examination (5) and the Ohio State University 
Psychological T est (6) . The individual scores on these tests were 
correlated with the individual grade-point averages for courses 
taken in engineering, mathematics, physical science (excluding 
chemistry), chemistry, biological sciences, and for all courses 
taken. The number of academic quarters involved varied be- 
tween one and six, with an average of slightly more than two. 

The number of students involved was 376, all males, who 
took these various tests during the calendar year of 1946 or the 
first quarter of 1947. The majority were veterans of the armed 
services in the recent war. The distribution of the scores of this 
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group on the A.C.K. Test was parallel to that of the entire 
student body of 7,500 and the group is held to be a representa- 
tive sample of that student bntly. 

Major limitations of this study are the low reliability of in- 
structors’ marks and the fewness of the quarters available. 
Rogers (4), however, found an average reliability of college 
grades for eight semesters of .66, hut Traxler (6) found that the 
reliability of grades varied with the number of terms used. 
Read (3) found correlations between averages for each semester 
and the four-year averages of .73 to .83, with a relationship of 
.76 between tlie first-semester grades and the four-year aver- 
ages. Lehmann (i) found that tlie correlations of first-, 
third-, and sixth-quarter point-hour ratios, each with final 
cumulative point-hour ratio, were .66, .Ho, and .88 respectively. 
It would appear that grades from two quaitcrs are fairly repre- 
sentative of four-year college scholarship standings. 

The K\tanJorel Scioitijic Aptitiulc Test (R) was copyrighted in 
1929 and 1930, and is intended for use witli higli-school juniors 
and seniors and with college students. It attempts to measure 
scientific aptitude by means of eleven sub-tests upon the follow- 
ing topics: experimental bent, clarity of definition, suspended 
versus snap judgment, reasoning, inconsistencies, caution and 
thoroughness, discrimination of values in selecting and arrang- 
ing experimental data, accuracy of interpretation, and accuracy 
of observation. It is a power examination of the group, pencil- 
and-paper, and language types. One to two hours is usually 
required for its completion. It has no .set time limit. 

The Engineering and Physical Science Aptitude Test (2) was 
copyrighted in 1943, and is intended for use at the college level. 
It attempts to measure aptitude for engineering and for physi- 
cal science by means of six individually timed sub-tests on 
mathematics, formulation, physical science comprehension, 
arithmetic reasoning, verbal comprehension, and mechanical 
comprehension. It is a speed test of the group, pcncil-and- 
paper, and language types. It requires a total time of approx- 
imately seventy-five minutes for its admini.stration. 

The American Council on Education Psychological Examina- 
tion (5) is copyrighted in a new form annually. It attempts to 
measure general scholastic aptitude at the high-school senior 
and the coUege-freshman levels. Its six sub-tests yield two 
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sub-scores, a Q-score for quantitative comprehension and an 
L-score for linguistic comprehension, as well as a total or com- 
posite score. The six sub-tests are timed separately. It is a 
group, pencil-and-paper, speed test. It requires approximately 
sixty-five minutes for its administration. 

The Ohio State University ’Psychological Pest (6) is copy- 
righted as it is issued in new form from time to time It at- 
tempts to measure general scholastic aptitude at the high- 
school senior and college level. It has three sub-tests, the 
scores for each of which have norms, as well as a total score. 
It is a group, pencil-and-paper, power test. One to two hours is 
usually required for its completion. It has no set time limits. 

The grades used in this study were all from courses taken at 
Oregon State College. The grades carry “honor points” in the 
ratio of four for each hour of “A,” three for each hour of “B,” 
two for each hour of “C,” one for each hour of “D,” and none for 
each hour of “F.” Grades were available for two twelve-week 
quarters for 62 per cent of the 376 students, for one quarter for 
14 per cent, for three quarters for 10 per cent, and for four to 
six quarters for the remaining 14 per cent. 

The various correlations, their probable errors, and the num- 
ber of cases involved are shown in Table i. The correlations 
were found by the product-moment method, and are uncor- 
rected for attenuation. 

The results of this study indicate that the best single predic- 
tor of total scholastic achievement at the college level among 
the tests used was either the American Council on Education 
Psychological Examination total score or the Engineering and 
Science Aptitude Pest score. Each showed a correlation with 
total grade-point averages of .51, with a probable error of .03. 

Engineering grades could have been predicted equally well 
from the American Council on Education Psychological Exam- 
ination Q-score or total score, the Engineering and Physical 
Science Aptitude Pest, or the Stanford Scientific Aptitude Pest, 
with correlations of .40, .39, .39. and .37 respectively. While 
none of these correlations is high, they are very similar and 
show that the special aptitude tests were no better tools for 
prediction than the general aptitude test with this group. 

The prediction of mathematics grade-point averages could 
have been best accomplished by the American Council on Edu- 
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cation Psychological Examination Q-score, but it was closely- 
followed by the total score on the same test with a correlation 
of .41 for the latter in comparison with .43 for the former. 

Grades in physical science (excluding cliemistry) in this study 
could have been best predicted by the Engineering and Physi- 
cal Science Aptitude Pest with a correlation of .43, but it was 
followed closely by the American Council on Education Psy- 
chological Examination (total score) with a correlation of .38. 

TABLK I 
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Success in college chemistry courses could have been pre- 
dicted quite similarly from the Stanford Scientific Aptitude Pest 
scores, the Engineering and Physical Science Aptitude Pest score, 
and the American Council on Education Psychological Exam- 
ination (total score) with correlations of .57, ,56, and .54. 

Biological science grade-point averages could have been pre- 
dicted most accurately, in this study, from the Engineering and 
Physical Science Aptitude Pest scores, with the highest correla- 
tion of the study, .64. While the number used in finding this 
correlation was small the probable error was also small. 
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Never the less, this particular correlation may well be some- 
what fortuitous. 


Summary 

In this study, the Stanford Scientific Aptitude ’1‘est scor&s cor- 
related no better with grades in engineering and science courses 
than did the American Council on Education Psychological 
Examination partial or total scores, nor did it appear to dif- 
ferentiate between scientific aptitude and general scholastic 
ability. 

The Engineering and Scientific Aptitude T est, in this study, 
did not appear to predict success in engineering and physical 
science courses appreciably better than did the American 
Council on Education Psychological Examination, but it does 
appear to correlate slightly better with grades in biological 
science. In addition, it appears to correlate more closely with 
science grades than with engineering grades, and with biology 
grades more closely than other tests designed for that specific 
purpose. 
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